simpleqa

v1.0

SimpleQA: 4,326 short, fact-seeking questions from OpenAI for evaluating language model factuality. Uses LLM-as-a-judge grading. Source: https://openai.com/index/introducing-simpleqa/

uvx harbor run -d simpleqa@1.0

Tasks (4326)

simpleqa-1538
uvx harbor run -d simpleqa@1.0 -t simpleqa-1538
b8f0fa9
simpleqa-1539
uvx harbor run -d simpleqa@1.0 -t simpleqa-1539
b8f0fa9
simpleqa-154
uvx harbor run -d simpleqa@1.0 -t simpleqa-154
b8f0fa9
simpleqa-1540
uvx harbor run -d simpleqa@1.0 -t simpleqa-1540
b8f0fa9
simpleqa-1541
uvx harbor run -d simpleqa@1.0 -t simpleqa-1541
b8f0fa9
simpleqa-1542
uvx harbor run -d simpleqa@1.0 -t simpleqa-1542
b8f0fa9
simpleqa-1543
uvx harbor run -d simpleqa@1.0 -t simpleqa-1543
b8f0fa9
simpleqa-1544
uvx harbor run -d simpleqa@1.0 -t simpleqa-1544
b8f0fa9
simpleqa-1545
uvx harbor run -d simpleqa@1.0 -t simpleqa-1545
b8f0fa9
simpleqa-1546
uvx harbor run -d simpleqa@1.0 -t simpleqa-1546
b8f0fa9
simpleqa-1547
uvx harbor run -d simpleqa@1.0 -t simpleqa-1547
b8f0fa9
simpleqa-1548
uvx harbor run -d simpleqa@1.0 -t simpleqa-1548
b8f0fa9
simpleqa-1549
uvx harbor run -d simpleqa@1.0 -t simpleqa-1549
b8f0fa9
simpleqa-155
uvx harbor run -d simpleqa@1.0 -t simpleqa-155
b8f0fa9
simpleqa-1550
uvx harbor run -d simpleqa@1.0 -t simpleqa-1550
b8f0fa9
simpleqa-1551
uvx harbor run -d simpleqa@1.0 -t simpleqa-1551
b8f0fa9
simpleqa-1552
uvx harbor run -d simpleqa@1.0 -t simpleqa-1552
b8f0fa9
simpleqa-1553
uvx harbor run -d simpleqa@1.0 -t simpleqa-1553
b8f0fa9
simpleqa-1554
uvx harbor run -d simpleqa@1.0 -t simpleqa-1554
b8f0fa9
simpleqa-1555
uvx harbor run -d simpleqa@1.0 -t simpleqa-1555
b8f0fa9
simpleqa-1556
uvx harbor run -d simpleqa@1.0 -t simpleqa-1556
b8f0fa9
simpleqa-1557
uvx harbor run -d simpleqa@1.0 -t simpleqa-1557
b8f0fa9
simpleqa-1558
uvx harbor run -d simpleqa@1.0 -t simpleqa-1558
b8f0fa9
simpleqa-1559
uvx harbor run -d simpleqa@1.0 -t simpleqa-1559
b8f0fa9
simpleqa-156
uvx harbor run -d simpleqa@1.0 -t simpleqa-156
b8f0fa9
simpleqa-1560
uvx harbor run -d simpleqa@1.0 -t simpleqa-1560
b8f0fa9
simpleqa-1561
uvx harbor run -d simpleqa@1.0 -t simpleqa-1561
b8f0fa9
simpleqa-1562
uvx harbor run -d simpleqa@1.0 -t simpleqa-1562
b8f0fa9
simpleqa-1563
uvx harbor run -d simpleqa@1.0 -t simpleqa-1563
b8f0fa9
simpleqa-1564
uvx harbor run -d simpleqa@1.0 -t simpleqa-1564
b8f0fa9
simpleqa-1565
uvx harbor run -d simpleqa@1.0 -t simpleqa-1565
b8f0fa9
simpleqa-1566
uvx harbor run -d simpleqa@1.0 -t simpleqa-1566
b8f0fa9
simpleqa-1567
uvx harbor run -d simpleqa@1.0 -t simpleqa-1567
b8f0fa9
simpleqa-1568
uvx harbor run -d simpleqa@1.0 -t simpleqa-1568
b8f0fa9
simpleqa-1569
uvx harbor run -d simpleqa@1.0 -t simpleqa-1569
b8f0fa9
simpleqa-157
uvx harbor run -d simpleqa@1.0 -t simpleqa-157
b8f0fa9
simpleqa-1570
uvx harbor run -d simpleqa@1.0 -t simpleqa-1570
b8f0fa9
simpleqa-1571
uvx harbor run -d simpleqa@1.0 -t simpleqa-1571
b8f0fa9
simpleqa-1572
uvx harbor run -d simpleqa@1.0 -t simpleqa-1572
b8f0fa9
simpleqa-1573
uvx harbor run -d simpleqa@1.0 -t simpleqa-1573
b8f0fa9
simpleqa-1574
uvx harbor run -d simpleqa@1.0 -t simpleqa-1574
b8f0fa9
simpleqa-1575
uvx harbor run -d simpleqa@1.0 -t simpleqa-1575
b8f0fa9
simpleqa-1576
uvx harbor run -d simpleqa@1.0 -t simpleqa-1576
b8f0fa9
simpleqa-1577
uvx harbor run -d simpleqa@1.0 -t simpleqa-1577
b8f0fa9
simpleqa-1578
uvx harbor run -d simpleqa@1.0 -t simpleqa-1578
b8f0fa9
simpleqa-1579
uvx harbor run -d simpleqa@1.0 -t simpleqa-1579
b8f0fa9
simpleqa-158
uvx harbor run -d simpleqa@1.0 -t simpleqa-158
b8f0fa9
simpleqa-1580
uvx harbor run -d simpleqa@1.0 -t simpleqa-1580
b8f0fa9
simpleqa-1581
uvx harbor run -d simpleqa@1.0 -t simpleqa-1581
b8f0fa9
simpleqa-1582
uvx harbor run -d simpleqa@1.0 -t simpleqa-1582
b8f0fa9
simpleqa-1583
uvx harbor run -d simpleqa@1.0 -t simpleqa-1583
b8f0fa9
simpleqa-1584
uvx harbor run -d simpleqa@1.0 -t simpleqa-1584
b8f0fa9
simpleqa-1585
uvx harbor run -d simpleqa@1.0 -t simpleqa-1585
b8f0fa9
simpleqa-1586
uvx harbor run -d simpleqa@1.0 -t simpleqa-1586
b8f0fa9
simpleqa-1587
uvx harbor run -d simpleqa@1.0 -t simpleqa-1587
b8f0fa9
simpleqa-1588
uvx harbor run -d simpleqa@1.0 -t simpleqa-1588
b8f0fa9
simpleqa-1589
uvx harbor run -d simpleqa@1.0 -t simpleqa-1589
b8f0fa9
simpleqa-159
uvx harbor run -d simpleqa@1.0 -t simpleqa-159
b8f0fa9
simpleqa-1590
uvx harbor run -d simpleqa@1.0 -t simpleqa-1590
b8f0fa9
simpleqa-1591
uvx harbor run -d simpleqa@1.0 -t simpleqa-1591
b8f0fa9
simpleqa-1592
uvx harbor run -d simpleqa@1.0 -t simpleqa-1592
b8f0fa9
simpleqa-1593
uvx harbor run -d simpleqa@1.0 -t simpleqa-1593
b8f0fa9
simpleqa-1594
uvx harbor run -d simpleqa@1.0 -t simpleqa-1594
b8f0fa9
simpleqa-1595
uvx harbor run -d simpleqa@1.0 -t simpleqa-1595
b8f0fa9
simpleqa-1596
uvx harbor run -d simpleqa@1.0 -t simpleqa-1596
b8f0fa9
simpleqa-1597
uvx harbor run -d simpleqa@1.0 -t simpleqa-1597
b8f0fa9
simpleqa-1598
uvx harbor run -d simpleqa@1.0 -t simpleqa-1598
b8f0fa9
simpleqa-1599
uvx harbor run -d simpleqa@1.0 -t simpleqa-1599
b8f0fa9
simpleqa-16
uvx harbor run -d simpleqa@1.0 -t simpleqa-16
b8f0fa9
simpleqa-160
uvx harbor run -d simpleqa@1.0 -t simpleqa-160
b8f0fa9
simpleqa-1600
uvx harbor run -d simpleqa@1.0 -t simpleqa-1600
b8f0fa9
simpleqa-1601
uvx harbor run -d simpleqa@1.0 -t simpleqa-1601
b8f0fa9
simpleqa-1602
uvx harbor run -d simpleqa@1.0 -t simpleqa-1602
b8f0fa9
simpleqa-1603
uvx harbor run -d simpleqa@1.0 -t simpleqa-1603
b8f0fa9
simpleqa-1604
uvx harbor run -d simpleqa@1.0 -t simpleqa-1604
b8f0fa9
simpleqa-1605
uvx harbor run -d simpleqa@1.0 -t simpleqa-1605
b8f0fa9
simpleqa-1606
uvx harbor run -d simpleqa@1.0 -t simpleqa-1606
b8f0fa9
simpleqa-1607
uvx harbor run -d simpleqa@1.0 -t simpleqa-1607
b8f0fa9
simpleqa-1608
uvx harbor run -d simpleqa@1.0 -t simpleqa-1608
b8f0fa9
simpleqa-1609
uvx harbor run -d simpleqa@1.0 -t simpleqa-1609
b8f0fa9
simpleqa-161
uvx harbor run -d simpleqa@1.0 -t simpleqa-161
b8f0fa9
simpleqa-1610
uvx harbor run -d simpleqa@1.0 -t simpleqa-1610
b8f0fa9
simpleqa-1611
uvx harbor run -d simpleqa@1.0 -t simpleqa-1611
b8f0fa9
simpleqa-1612
uvx harbor run -d simpleqa@1.0 -t simpleqa-1612
b8f0fa9
simpleqa-1613
uvx harbor run -d simpleqa@1.0 -t simpleqa-1613
b8f0fa9
simpleqa-1614
uvx harbor run -d simpleqa@1.0 -t simpleqa-1614
b8f0fa9
simpleqa-1615
uvx harbor run -d simpleqa@1.0 -t simpleqa-1615
b8f0fa9
simpleqa-1616
uvx harbor run -d simpleqa@1.0 -t simpleqa-1616
b8f0fa9
simpleqa-1617
uvx harbor run -d simpleqa@1.0 -t simpleqa-1617
b8f0fa9
simpleqa-1618
uvx harbor run -d simpleqa@1.0 -t simpleqa-1618
b8f0fa9
simpleqa-1619
uvx harbor run -d simpleqa@1.0 -t simpleqa-1619
b8f0fa9
simpleqa-162
uvx harbor run -d simpleqa@1.0 -t simpleqa-162
b8f0fa9
simpleqa-1620
uvx harbor run -d simpleqa@1.0 -t simpleqa-1620
b8f0fa9
simpleqa-1621
uvx harbor run -d simpleqa@1.0 -t simpleqa-1621
b8f0fa9
simpleqa-1622
uvx harbor run -d simpleqa@1.0 -t simpleqa-1622
b8f0fa9
simpleqa-1623
uvx harbor run -d simpleqa@1.0 -t simpleqa-1623
b8f0fa9
simpleqa-1624
uvx harbor run -d simpleqa@1.0 -t simpleqa-1624
b8f0fa9
simpleqa-1625
uvx harbor run -d simpleqa@1.0 -t simpleqa-1625
b8f0fa9
simpleqa-1626
uvx harbor run -d simpleqa@1.0 -t simpleqa-1626
b8f0fa9
simpleqa-1627
uvx harbor run -d simpleqa@1.0 -t simpleqa-1627
b8f0fa9