Posted by msmash from Slashdot
From the intensifying-race department: Meta debuted a new version of its powerful Llama AI model, its latest effort to keep pace with similar technology from companies like OpenAI, X and Google. The company describes Llama 3 8B and Llama 3 70B, containing 8 billion and 70 billion parameters respectively, as a "major leap" in performance compared to their predecessors.
Meta claims that the Llama 3 models, trained on custom-built 24,000 GPU clusters, are among the best-performing generative AI models available for their respective parameter counts. The company supports this claim by citing the models' scores on popular AI benchmarks such as MMLU, ARC, and DROP, which attempt to measure knowledge, skill acquisition, and reasoning abilities. Despite the ongoing debate about the usefulness and validity of these benchmarks, they remain one of the few standardized methods for evaluating AI models. Llama 3 8B outperforms other open-source models like Mistral's Mistral 7B and Google's Gemma 7B on at least nine benchmarks, showcasing its potential in various domains such as biology, physics, chemistry, mathematics, and commonsense reasoning.
TechCrunch adds: Now, Mistral 7B and Gemma 7B aren't exactly on the bleeding edge (Mistral 7B was released last September), and in a few of benchmarks Meta cites, Llama 3 8B scores only a few percentage points higher than either. But Meta also makes the claim that the larger-parameter-count Llama 3 model, Llama 3 70B, is competitive with flagship generative AI models including Gemini 1.5 Pro, the latest in Google's Gemini series.
Posted by msmash from Slashdot
From the how-about-that department: Google CEO Sundar Pichai announced substantial internal reorganizations on Thursday, including the creation of a new team called "Platforms and Devices" that will oversee all of Google's Pixel products, all of Android, Chrome, ChromeOS, Photos, and more. From a report: The team will be run by Rick Osterloh, who was previously the SVP of devices and services, overseeing all of Google's hardware efforts. Hiroshi Lockheimer, the longtime head of Android, Chrome, and ChromeOS, will be taking on other projects inside of Google and Alphabet. This is a huge change for Google, and it likely won't be the last one. There's only one reason for all of it, Osterloh says: AI. "This is not a secret, right?" he says.
Consolidating teams "helps us to be able to do full-stack innovation when that's necessary," Osterloh says. He uses the example of the Pixel camera: "You had to have deep knowledge of the hardware systems, from the sensors to the ISPs, to all layers of the software stack. And, at the time, all the early HDR and ML models that were doing camera processing... and I think that hardware / software / AI integration really showed how AI could totally transform a user experience. That was important. And it's even more true today."
Posted by msmash from Slashdot
From the gaining-momentum department: U.S. lawmakers have moved closer to enacting a countrywide ban on TikTok. From a report: Last month, the House of Representatives passed a bill by a wide margin that would ban distribution of TikTok in U.S. unless TikTok's Chinese parent, ByteDance, sells its ownership in the app within 165 days of the law's enactment. On Wednesday, House Speaker Mike Johnson issued a new proposal that would extend the sale requirement deadline to nine months, with a potential for a 90-day extension -- addressing a key concern of Sen. Maria Cantwell (D-Wash.), chair of the Senate's Commerce, Science and Transportation Committee, that the divestiture timeline was too short.
The revised TikTok ban proposal is tied to a broader bill providing emergency aid for Ukraine and Israel; the House is expected to vote on the measure Saturday, and if it passes would move to the Senate. President Biden has said he will sign the TikTok divest-or-ban legislation into law. On Wednesday evening, Cantwell said she supported the revised TikTok ban bill. "I'm very happy that Speaker Johnson and House leaders incorporated my recommendation to extend the ByteDance divestment period from six months to a year," she said in a statement. "As I've said, extending the divestment period is necessary to ensure there is enough time for a new buyer to get a deal done. I support this updated legislation."
Posted by msmash from Slashdot
From the moving-forward department: Researchers in Canada got most of what they were hoping for in the country's 2024 federal budget, with a big boost in postgraduate pay and more funding for research and scientific infrastructure. From a report: "We are investing over $5 billion in Canadian brainpower," said finance minister Chrystia Freeland in her budget speech on 16 April. "More funding for research and scholarships will help Canada attract the next generation of game-changing thinkers."
Postgraduate students and postdoctoral researchers have been advocating for higher pay for the past two years through a campaign called Support Our Science. They requested an increase in the value, and number, of federal government scholarships, and got more than they asked for. Stipends for master's students will rise from Can$17,500 (US$12,700) to $27,000 per year, PhDs stipends that ranged from $20,000 to $35,000 will be set to a uniform annual $40,000 and most postdoctoral-fellowship salaries will increase from $45,000 to $70,000 per annum. The number of scholarships and fellowships provided will also rise over time, building to around 1,720 more per year after five years.
"We're very thrilled with this significant new investment, the largest investment in graduate students and postdocs in over 21 years," says Kaitlin Kharas, a PhD student at the University of Toronto, Canada, and executive director of Support Our Science. "It will directly support the next generation of researchers." Although only a small proportion of students and postdoctoral fellows receive these federal scholarships, other funders tend to use them as a guide for their own stipends. Many postgraduates said that low pay was forcing them to consider leaving Canada to pursue their scientific career, says Kharas, so this funding should help to retain talent in the country.