![]() ![]() This allowed developers around the world to fully access a GPT-level LLM for the first time. It had made LLaMA’s model weights available for academics and researchers on a case-by-case basis - including Stanford for the Alpaca project - but those weights were subsequently leaked on 4chan. Meta is known as a particularly “open” Big Tech company (thanks to FAIR, the Fundamental AI Research Team founded by Meta’s chief AI scientist Yann LeCun in 2013). Unfortunately, Meta appears to have failed to conduct any meaningful risk assessment in advance of release, despite the realistic potential for broad distribution, even if unauthorized.” Meta known as a particularly ‘open’ Big Tech company “While Meta has described the release as a leak, its chief AI scientist has stated that open models are key to its commercial success. “Given the seemingly minimal protections built into LLaMA’s release, Meta should have known that LLaMA would be broadly disseminated, and must have anticipated the potential for abuse,” it continues. ![]() “The choice to distribute LLaMA in such an unrestrained and permissive manner raises important and complicated questions about when and how it is appropriate to openly release sophisticated AI models,” the letter says. The Senators had harsh words for Zuckerberg regarding LLaMA’s distribution and the use of the word “leak.” Senators criticize Meta’s use of the word ‘leak’ ![]() Vicuna is a fine-tuned version of LLaMA that matches GPT-4 performance. Alpaca, in turn, used the weights from Meta’s LLaMA model. For example, Databricks announced the ChatGPT-like Dolly, which was inspired by Alpaca, another open-source LLM released by Stanford in mid-March. LLaMA, on its release, was immediately hailed for its superior performance over models such as GPT – 3, despite having 10 times fewer parameters. Some open-source models released were tied to LLaMA. The open dissemination of LLaMA represents a significant increase in the sophistication of the AI models available to the general public, and raises serious questions about the potential for misuse or abuse.”Ĭalling out the LLaMA leak seems to be a swipe at the open source community, which has been having both a moment and a red-hot debate over the past months - following a wave of recent large language model (LLM) releases and an effort by startups, collectives and academics to push back on the shift in AI to closed, proprietary LLMs and democratize access to LLMs. Regrettably, but predictably, within days of the announcement, the full model appeared on BitTorrent, making it available to anyone, anywhere in the world, without monitoring or oversight. The letter continues: “While LLaMA was reportedly trained on public data, it differed from past models available to the public based on its size and sophistication. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |