Matthew Lynley - Profile and Journalist Details

Beats

Content

Total articles 1694

• Please send OpenAI your good vibes as it dives into model evaluation

  By Matthew Lynley| Supervised@ While OpenAI’s advanced o1 “stop and think for a second” models may be a technical feat, it’s also increasingly working to enable developers onto its significantly cheaper workhorse models. As part of this, OpenAI has to wade into one of modern AI’s comically difficult problems: evaluating whether the response of a model is “good” in some quantitative and automated way. The industry has long tried to graduate out of vibes-based evaluation, but as of yet there’s no immediately reasonable solution.

  By Matthew Lynley · Supervised

  Oct. 01, 2024

• A rare opening against Datadog

  By Matthew Lynley| Supervised@ This issue was finished on a mobile device so I apologize ahead of time for any typos and formatting errors. While OpenAI’s latest model, o1, is clearly a massive improvement in performance it’s also creating a potentially new challenge: product sprawl. Its latest products, o1 and o1-mini, essentially gives users and customers a tradeoff: you can wait longer and, for now, spend more, but the output should be much better.

  By Matthew Lynley · Supervised

  Sep. 27, 2024

• Please send OpenAI your good vibes as it dives into model evaluation

  By Matthew Lynley| Supervised@ While OpenAI’s advanced o1 “stop and think for a second” models may be a technical feat, it’s also increasingly working to enable developers onto its significantly cheaper workhorse models. As part of this, OpenAI has to wade into one of modern AI’s comically difficult problems: evaluating whether the response of a model is “good” in some quantitative and automated way. The industry has long tried to graduate out of vibes-based evaluation, but as of yet there’s no immediately reasonable solution.

  By Matthew Lynley · Supervised

  Oct. 01, 2024

As seen in

Company Info

Supervised