Andrej Karpathy on

evaluation

2 entries, 2 Aug 2026 to 2 Aug 2026

On the recordsourced and dated, oldest first

    1. reported

      Testing language models is moving beyond simple creative tasks like generating SVG images of bicycling pelicans.

      “We’re starting to leave the territory where you’d test an LLM by e.g. ‘create an svg of pelican on a bicycle,’”

      2 Aug 2026 · TradingView · source
    2. reported

      AI testing is moving beyond simple benchmark evaluations.

      “We're starting to leave the territory where you'd test an LLM by e.g. ”

      2 Aug 2026 · X (formerly Twitter) · https://x.com/karpathy · source

Andrej Karpathy ontheir other subjects

Everything Andrej Karpathy is on record saying · RSS