simpleqa

v1.0

SimpleQA: 4,326 short, fact-seeking questions from OpenAI for evaluating language model factuality. Uses LLM-as-a-judge grading. Source: https://openai.com/index/introducing-simpleqa/

uvx harbor run -d simpleqa@1.0

Tasks (4326)

simpleqa-2168
uvx harbor run -d simpleqa@1.0 -t simpleqa-2168
b8f0fa9
simpleqa-2169
uvx harbor run -d simpleqa@1.0 -t simpleqa-2169
b8f0fa9
simpleqa-217
uvx harbor run -d simpleqa@1.0 -t simpleqa-217
b8f0fa9
simpleqa-2170
uvx harbor run -d simpleqa@1.0 -t simpleqa-2170
b8f0fa9
simpleqa-2171
uvx harbor run -d simpleqa@1.0 -t simpleqa-2171
b8f0fa9
simpleqa-2172
uvx harbor run -d simpleqa@1.0 -t simpleqa-2172
b8f0fa9
simpleqa-2173
uvx harbor run -d simpleqa@1.0 -t simpleqa-2173
b8f0fa9
simpleqa-2174
uvx harbor run -d simpleqa@1.0 -t simpleqa-2174
b8f0fa9
simpleqa-2175
uvx harbor run -d simpleqa@1.0 -t simpleqa-2175
b8f0fa9
simpleqa-2176
uvx harbor run -d simpleqa@1.0 -t simpleqa-2176
b8f0fa9
simpleqa-2177
uvx harbor run -d simpleqa@1.0 -t simpleqa-2177
b8f0fa9
simpleqa-2178
uvx harbor run -d simpleqa@1.0 -t simpleqa-2178
b8f0fa9
simpleqa-2179
uvx harbor run -d simpleqa@1.0 -t simpleqa-2179
b8f0fa9
simpleqa-218
uvx harbor run -d simpleqa@1.0 -t simpleqa-218
b8f0fa9
simpleqa-2180
uvx harbor run -d simpleqa@1.0 -t simpleqa-2180
b8f0fa9
simpleqa-2181
uvx harbor run -d simpleqa@1.0 -t simpleqa-2181
b8f0fa9
simpleqa-2182
uvx harbor run -d simpleqa@1.0 -t simpleqa-2182
b8f0fa9
simpleqa-2183
uvx harbor run -d simpleqa@1.0 -t simpleqa-2183
b8f0fa9
simpleqa-2184
uvx harbor run -d simpleqa@1.0 -t simpleqa-2184
b8f0fa9
simpleqa-2185
uvx harbor run -d simpleqa@1.0 -t simpleqa-2185
b8f0fa9
simpleqa-2186
uvx harbor run -d simpleqa@1.0 -t simpleqa-2186
b8f0fa9
simpleqa-2187
uvx harbor run -d simpleqa@1.0 -t simpleqa-2187
b8f0fa9
simpleqa-2188
uvx harbor run -d simpleqa@1.0 -t simpleqa-2188
b8f0fa9
simpleqa-2189
uvx harbor run -d simpleqa@1.0 -t simpleqa-2189
b8f0fa9
simpleqa-219
uvx harbor run -d simpleqa@1.0 -t simpleqa-219
b8f0fa9
simpleqa-2190
uvx harbor run -d simpleqa@1.0 -t simpleqa-2190
b8f0fa9
simpleqa-2191
uvx harbor run -d simpleqa@1.0 -t simpleqa-2191
b8f0fa9
simpleqa-2192
uvx harbor run -d simpleqa@1.0 -t simpleqa-2192
b8f0fa9
simpleqa-2193
uvx harbor run -d simpleqa@1.0 -t simpleqa-2193
b8f0fa9
simpleqa-2194
uvx harbor run -d simpleqa@1.0 -t simpleqa-2194
b8f0fa9
simpleqa-2195
uvx harbor run -d simpleqa@1.0 -t simpleqa-2195
b8f0fa9
simpleqa-2196
uvx harbor run -d simpleqa@1.0 -t simpleqa-2196
b8f0fa9
simpleqa-2197
uvx harbor run -d simpleqa@1.0 -t simpleqa-2197
b8f0fa9
simpleqa-2198
uvx harbor run -d simpleqa@1.0 -t simpleqa-2198
b8f0fa9
simpleqa-2199
uvx harbor run -d simpleqa@1.0 -t simpleqa-2199
b8f0fa9
simpleqa-22
uvx harbor run -d simpleqa@1.0 -t simpleqa-22
b8f0fa9
simpleqa-220
uvx harbor run -d simpleqa@1.0 -t simpleqa-220
b8f0fa9
simpleqa-2200
uvx harbor run -d simpleqa@1.0 -t simpleqa-2200
b8f0fa9
simpleqa-2201
uvx harbor run -d simpleqa@1.0 -t simpleqa-2201
b8f0fa9
simpleqa-2202
uvx harbor run -d simpleqa@1.0 -t simpleqa-2202
b8f0fa9
simpleqa-2203
uvx harbor run -d simpleqa@1.0 -t simpleqa-2203
b8f0fa9
simpleqa-2204
uvx harbor run -d simpleqa@1.0 -t simpleqa-2204
b8f0fa9
simpleqa-2205
uvx harbor run -d simpleqa@1.0 -t simpleqa-2205
b8f0fa9
simpleqa-2206
uvx harbor run -d simpleqa@1.0 -t simpleqa-2206
b8f0fa9
simpleqa-2207
uvx harbor run -d simpleqa@1.0 -t simpleqa-2207
b8f0fa9
simpleqa-2208
uvx harbor run -d simpleqa@1.0 -t simpleqa-2208
b8f0fa9
simpleqa-2209
uvx harbor run -d simpleqa@1.0 -t simpleqa-2209
b8f0fa9
simpleqa-221
uvx harbor run -d simpleqa@1.0 -t simpleqa-221
b8f0fa9
simpleqa-2210
uvx harbor run -d simpleqa@1.0 -t simpleqa-2210
b8f0fa9
simpleqa-2211
uvx harbor run -d simpleqa@1.0 -t simpleqa-2211
b8f0fa9
simpleqa-2212
uvx harbor run -d simpleqa@1.0 -t simpleqa-2212
b8f0fa9
simpleqa-2213
uvx harbor run -d simpleqa@1.0 -t simpleqa-2213
b8f0fa9
simpleqa-2214
uvx harbor run -d simpleqa@1.0 -t simpleqa-2214
b8f0fa9
simpleqa-2215
uvx harbor run -d simpleqa@1.0 -t simpleqa-2215
b8f0fa9
simpleqa-2216
uvx harbor run -d simpleqa@1.0 -t simpleqa-2216
b8f0fa9
simpleqa-2217
uvx harbor run -d simpleqa@1.0 -t simpleqa-2217
b8f0fa9
simpleqa-2218
uvx harbor run -d simpleqa@1.0 -t simpleqa-2218
b8f0fa9
simpleqa-2219
uvx harbor run -d simpleqa@1.0 -t simpleqa-2219
b8f0fa9
simpleqa-222
uvx harbor run -d simpleqa@1.0 -t simpleqa-222
b8f0fa9
simpleqa-2220
uvx harbor run -d simpleqa@1.0 -t simpleqa-2220
b8f0fa9
simpleqa-2221
uvx harbor run -d simpleqa@1.0 -t simpleqa-2221
b8f0fa9
simpleqa-2222
uvx harbor run -d simpleqa@1.0 -t simpleqa-2222
b8f0fa9
simpleqa-2223
uvx harbor run -d simpleqa@1.0 -t simpleqa-2223
b8f0fa9
simpleqa-2224
uvx harbor run -d simpleqa@1.0 -t simpleqa-2224
b8f0fa9
simpleqa-2225
uvx harbor run -d simpleqa@1.0 -t simpleqa-2225
b8f0fa9
simpleqa-2226
uvx harbor run -d simpleqa@1.0 -t simpleqa-2226
b8f0fa9
simpleqa-2227
uvx harbor run -d simpleqa@1.0 -t simpleqa-2227
b8f0fa9
simpleqa-2228
uvx harbor run -d simpleqa@1.0 -t simpleqa-2228
b8f0fa9
simpleqa-2229
uvx harbor run -d simpleqa@1.0 -t simpleqa-2229
b8f0fa9
simpleqa-223
uvx harbor run -d simpleqa@1.0 -t simpleqa-223
b8f0fa9
simpleqa-2230
uvx harbor run -d simpleqa@1.0 -t simpleqa-2230
b8f0fa9
simpleqa-2231
uvx harbor run -d simpleqa@1.0 -t simpleqa-2231
b8f0fa9
simpleqa-2232
uvx harbor run -d simpleqa@1.0 -t simpleqa-2232
b8f0fa9
simpleqa-2233
uvx harbor run -d simpleqa@1.0 -t simpleqa-2233
b8f0fa9
simpleqa-2234
uvx harbor run -d simpleqa@1.0 -t simpleqa-2234
b8f0fa9
simpleqa-2235
uvx harbor run -d simpleqa@1.0 -t simpleqa-2235
b8f0fa9
simpleqa-2236
uvx harbor run -d simpleqa@1.0 -t simpleqa-2236
b8f0fa9
simpleqa-2237
uvx harbor run -d simpleqa@1.0 -t simpleqa-2237
b8f0fa9
simpleqa-2238
uvx harbor run -d simpleqa@1.0 -t simpleqa-2238
b8f0fa9
simpleqa-2239
uvx harbor run -d simpleqa@1.0 -t simpleqa-2239
b8f0fa9
simpleqa-224
uvx harbor run -d simpleqa@1.0 -t simpleqa-224
b8f0fa9
simpleqa-2240
uvx harbor run -d simpleqa@1.0 -t simpleqa-2240
b8f0fa9
simpleqa-2241
uvx harbor run -d simpleqa@1.0 -t simpleqa-2241
b8f0fa9
simpleqa-2242
uvx harbor run -d simpleqa@1.0 -t simpleqa-2242
b8f0fa9
simpleqa-2243
uvx harbor run -d simpleqa@1.0 -t simpleqa-2243
b8f0fa9
simpleqa-2244
uvx harbor run -d simpleqa@1.0 -t simpleqa-2244
b8f0fa9
simpleqa-2245
uvx harbor run -d simpleqa@1.0 -t simpleqa-2245
b8f0fa9
simpleqa-2246
uvx harbor run -d simpleqa@1.0 -t simpleqa-2246
b8f0fa9
simpleqa-2247
uvx harbor run -d simpleqa@1.0 -t simpleqa-2247
b8f0fa9
simpleqa-2248
uvx harbor run -d simpleqa@1.0 -t simpleqa-2248
b8f0fa9
simpleqa-2249
uvx harbor run -d simpleqa@1.0 -t simpleqa-2249
b8f0fa9
simpleqa-225
uvx harbor run -d simpleqa@1.0 -t simpleqa-225
b8f0fa9
simpleqa-2250
uvx harbor run -d simpleqa@1.0 -t simpleqa-2250
b8f0fa9
simpleqa-2251
uvx harbor run -d simpleqa@1.0 -t simpleqa-2251
b8f0fa9
simpleqa-2252
uvx harbor run -d simpleqa@1.0 -t simpleqa-2252
b8f0fa9
simpleqa-2253
uvx harbor run -d simpleqa@1.0 -t simpleqa-2253
b8f0fa9
simpleqa-2254
uvx harbor run -d simpleqa@1.0 -t simpleqa-2254
b8f0fa9
simpleqa-2255
uvx harbor run -d simpleqa@1.0 -t simpleqa-2255
b8f0fa9
simpleqa-2256
uvx harbor run -d simpleqa@1.0 -t simpleqa-2256
b8f0fa9
simpleqa-2257
uvx harbor run -d simpleqa@1.0 -t simpleqa-2257
b8f0fa9