simpleqa

v1.0

SimpleQA: 4,326 short, fact-seeking questions from OpenAI for evaluating language model factuality. Uses LLM-as-a-judge grading. Source: https://openai.com/index/introducing-simpleqa/

uvx harbor run -d simpleqa@1.0

Tasks (4326)

simpleqa-705
uvx harbor run -d simpleqa@1.0 -t simpleqa-705
b8f0fa9
simpleqa-706
uvx harbor run -d simpleqa@1.0 -t simpleqa-706
b8f0fa9
simpleqa-707
uvx harbor run -d simpleqa@1.0 -t simpleqa-707
b8f0fa9
simpleqa-708
uvx harbor run -d simpleqa@1.0 -t simpleqa-708
b8f0fa9
simpleqa-709
uvx harbor run -d simpleqa@1.0 -t simpleqa-709
b8f0fa9
simpleqa-71
uvx harbor run -d simpleqa@1.0 -t simpleqa-71
b8f0fa9
simpleqa-710
uvx harbor run -d simpleqa@1.0 -t simpleqa-710
b8f0fa9
simpleqa-711
uvx harbor run -d simpleqa@1.0 -t simpleqa-711
b8f0fa9
simpleqa-712
uvx harbor run -d simpleqa@1.0 -t simpleqa-712
b8f0fa9
simpleqa-713
uvx harbor run -d simpleqa@1.0 -t simpleqa-713
b8f0fa9
simpleqa-714
uvx harbor run -d simpleqa@1.0 -t simpleqa-714
b8f0fa9
simpleqa-715
uvx harbor run -d simpleqa@1.0 -t simpleqa-715
b8f0fa9
simpleqa-716
uvx harbor run -d simpleqa@1.0 -t simpleqa-716
b8f0fa9
simpleqa-717
uvx harbor run -d simpleqa@1.0 -t simpleqa-717
b8f0fa9
simpleqa-718
uvx harbor run -d simpleqa@1.0 -t simpleqa-718
b8f0fa9
simpleqa-719
uvx harbor run -d simpleqa@1.0 -t simpleqa-719
b8f0fa9
simpleqa-72
uvx harbor run -d simpleqa@1.0 -t simpleqa-72
b8f0fa9
simpleqa-720
uvx harbor run -d simpleqa@1.0 -t simpleqa-720
b8f0fa9
simpleqa-721
uvx harbor run -d simpleqa@1.0 -t simpleqa-721
b8f0fa9
simpleqa-722
uvx harbor run -d simpleqa@1.0 -t simpleqa-722
b8f0fa9
simpleqa-723
uvx harbor run -d simpleqa@1.0 -t simpleqa-723
b8f0fa9
simpleqa-724
uvx harbor run -d simpleqa@1.0 -t simpleqa-724
b8f0fa9
simpleqa-725
uvx harbor run -d simpleqa@1.0 -t simpleqa-725
b8f0fa9
simpleqa-726
uvx harbor run -d simpleqa@1.0 -t simpleqa-726
b8f0fa9
simpleqa-727
uvx harbor run -d simpleqa@1.0 -t simpleqa-727
b8f0fa9
simpleqa-728
uvx harbor run -d simpleqa@1.0 -t simpleqa-728
b8f0fa9
simpleqa-729
uvx harbor run -d simpleqa@1.0 -t simpleqa-729
b8f0fa9
simpleqa-73
uvx harbor run -d simpleqa@1.0 -t simpleqa-73
b8f0fa9
simpleqa-730
uvx harbor run -d simpleqa@1.0 -t simpleqa-730
b8f0fa9
simpleqa-731
uvx harbor run -d simpleqa@1.0 -t simpleqa-731
b8f0fa9
simpleqa-732
uvx harbor run -d simpleqa@1.0 -t simpleqa-732
b8f0fa9
simpleqa-733
uvx harbor run -d simpleqa@1.0 -t simpleqa-733
b8f0fa9
simpleqa-734
uvx harbor run -d simpleqa@1.0 -t simpleqa-734
b8f0fa9
simpleqa-735
uvx harbor run -d simpleqa@1.0 -t simpleqa-735
b8f0fa9
simpleqa-736
uvx harbor run -d simpleqa@1.0 -t simpleqa-736
b8f0fa9
simpleqa-737
uvx harbor run -d simpleqa@1.0 -t simpleqa-737
b8f0fa9
simpleqa-738
uvx harbor run -d simpleqa@1.0 -t simpleqa-738
b8f0fa9
simpleqa-739
uvx harbor run -d simpleqa@1.0 -t simpleqa-739
b8f0fa9
simpleqa-74
uvx harbor run -d simpleqa@1.0 -t simpleqa-74
b8f0fa9
simpleqa-740
uvx harbor run -d simpleqa@1.0 -t simpleqa-740
b8f0fa9
simpleqa-741
uvx harbor run -d simpleqa@1.0 -t simpleqa-741
b8f0fa9
simpleqa-742
uvx harbor run -d simpleqa@1.0 -t simpleqa-742
b8f0fa9
simpleqa-743
uvx harbor run -d simpleqa@1.0 -t simpleqa-743
b8f0fa9
simpleqa-744
uvx harbor run -d simpleqa@1.0 -t simpleqa-744
b8f0fa9
simpleqa-745
uvx harbor run -d simpleqa@1.0 -t simpleqa-745
b8f0fa9
simpleqa-746
uvx harbor run -d simpleqa@1.0 -t simpleqa-746
b8f0fa9
simpleqa-747
uvx harbor run -d simpleqa@1.0 -t simpleqa-747
b8f0fa9
simpleqa-748
uvx harbor run -d simpleqa@1.0 -t simpleqa-748
b8f0fa9
simpleqa-749
uvx harbor run -d simpleqa@1.0 -t simpleqa-749
b8f0fa9
simpleqa-75
uvx harbor run -d simpleqa@1.0 -t simpleqa-75
b8f0fa9
simpleqa-750
uvx harbor run -d simpleqa@1.0 -t simpleqa-750
b8f0fa9
simpleqa-751
uvx harbor run -d simpleqa@1.0 -t simpleqa-751
b8f0fa9
simpleqa-752
uvx harbor run -d simpleqa@1.0 -t simpleqa-752
b8f0fa9
simpleqa-753
uvx harbor run -d simpleqa@1.0 -t simpleqa-753
b8f0fa9
simpleqa-754
uvx harbor run -d simpleqa@1.0 -t simpleqa-754
b8f0fa9
simpleqa-755
uvx harbor run -d simpleqa@1.0 -t simpleqa-755
b8f0fa9
simpleqa-756
uvx harbor run -d simpleqa@1.0 -t simpleqa-756
b8f0fa9
simpleqa-757
uvx harbor run -d simpleqa@1.0 -t simpleqa-757
b8f0fa9
simpleqa-758
uvx harbor run -d simpleqa@1.0 -t simpleqa-758
b8f0fa9
simpleqa-759
uvx harbor run -d simpleqa@1.0 -t simpleqa-759
b8f0fa9
simpleqa-76
uvx harbor run -d simpleqa@1.0 -t simpleqa-76
b8f0fa9
simpleqa-760
uvx harbor run -d simpleqa@1.0 -t simpleqa-760
b8f0fa9
simpleqa-761
uvx harbor run -d simpleqa@1.0 -t simpleqa-761
b8f0fa9
simpleqa-762
uvx harbor run -d simpleqa@1.0 -t simpleqa-762
b8f0fa9
simpleqa-763
uvx harbor run -d simpleqa@1.0 -t simpleqa-763
b8f0fa9
simpleqa-764
uvx harbor run -d simpleqa@1.0 -t simpleqa-764
b8f0fa9
simpleqa-765
uvx harbor run -d simpleqa@1.0 -t simpleqa-765
b8f0fa9
simpleqa-766
uvx harbor run -d simpleqa@1.0 -t simpleqa-766
b8f0fa9
simpleqa-767
uvx harbor run -d simpleqa@1.0 -t simpleqa-767
b8f0fa9
simpleqa-768
uvx harbor run -d simpleqa@1.0 -t simpleqa-768
b8f0fa9
simpleqa-769
uvx harbor run -d simpleqa@1.0 -t simpleqa-769
b8f0fa9
simpleqa-77
uvx harbor run -d simpleqa@1.0 -t simpleqa-77
b8f0fa9
simpleqa-770
uvx harbor run -d simpleqa@1.0 -t simpleqa-770
b8f0fa9
simpleqa-771
uvx harbor run -d simpleqa@1.0 -t simpleqa-771
b8f0fa9
simpleqa-772
uvx harbor run -d simpleqa@1.0 -t simpleqa-772
b8f0fa9
simpleqa-773
uvx harbor run -d simpleqa@1.0 -t simpleqa-773
b8f0fa9
simpleqa-774
uvx harbor run -d simpleqa@1.0 -t simpleqa-774
b8f0fa9
simpleqa-775
uvx harbor run -d simpleqa@1.0 -t simpleqa-775
b8f0fa9
simpleqa-776
uvx harbor run -d simpleqa@1.0 -t simpleqa-776
b8f0fa9
simpleqa-777
uvx harbor run -d simpleqa@1.0 -t simpleqa-777
b8f0fa9
simpleqa-778
uvx harbor run -d simpleqa@1.0 -t simpleqa-778
b8f0fa9
simpleqa-779
uvx harbor run -d simpleqa@1.0 -t simpleqa-779
b8f0fa9
simpleqa-78
uvx harbor run -d simpleqa@1.0 -t simpleqa-78
b8f0fa9
simpleqa-780
uvx harbor run -d simpleqa@1.0 -t simpleqa-780
b8f0fa9
simpleqa-781
uvx harbor run -d simpleqa@1.0 -t simpleqa-781
b8f0fa9
simpleqa-782
uvx harbor run -d simpleqa@1.0 -t simpleqa-782
b8f0fa9
simpleqa-783
uvx harbor run -d simpleqa@1.0 -t simpleqa-783
b8f0fa9
simpleqa-784
uvx harbor run -d simpleqa@1.0 -t simpleqa-784
b8f0fa9
simpleqa-785
uvx harbor run -d simpleqa@1.0 -t simpleqa-785
b8f0fa9
simpleqa-786
uvx harbor run -d simpleqa@1.0 -t simpleqa-786
b8f0fa9
simpleqa-787
uvx harbor run -d simpleqa@1.0 -t simpleqa-787
b8f0fa9
simpleqa-788
uvx harbor run -d simpleqa@1.0 -t simpleqa-788
b8f0fa9
simpleqa-789
uvx harbor run -d simpleqa@1.0 -t simpleqa-789
b8f0fa9
simpleqa-79
uvx harbor run -d simpleqa@1.0 -t simpleqa-79
b8f0fa9
simpleqa-790
uvx harbor run -d simpleqa@1.0 -t simpleqa-790
b8f0fa9
simpleqa-791
uvx harbor run -d simpleqa@1.0 -t simpleqa-791
b8f0fa9
simpleqa-792
uvx harbor run -d simpleqa@1.0 -t simpleqa-792
b8f0fa9
simpleqa-793
uvx harbor run -d simpleqa@1.0 -t simpleqa-793
b8f0fa9
simpleqa-794
uvx harbor run -d simpleqa@1.0 -t simpleqa-794
b8f0fa9
simpleqa-795
uvx harbor run -d simpleqa@1.0 -t simpleqa-795
b8f0fa9