• 8 Posts
  • 458 Comments
Joined 6 months ago
cake
Cake day: May 11th, 2024

help-circle


  • I think it’s more likely a compound sigmoid (don’t Google that). LLMs are composed of distinct technologies working together. As we’ve reached the inflection point of the scaling for one, we’ve pivoted implementations to get back on track. Notably, context windows are no longer an issue. But the most recent pivot came just this week, allowing for a huge jump in performance. There are more promising stepping stones coming into view. Is the exponential curve just a series of sigmoids stacked too close together? In any case, the article’s correct - just adding more compute to the same exact implementation hasn’t enabled scaling exponentially.


















  • President Biden included funding to expand the Community Eligibility Provision (CEP) in the his Fiscal Year 2024 budget.

    The budget earmarks over $15 billion in funds to allow more school districts to take advantage of CEP, which allows schools that have a high percentage of low-income students serve universal free meals.

    The White House has advocated for the expansion of universal free meals at school and aims to provide free school meals to 9 million more students by 2032 as part of its National Strategy on Hunger, Nutrition and Health. [March 2023]

    They also apparently made them more nutritious.