Amazon trains 980M parameter LLM with ’emergent abilities’

Researchers at Amazon have trained a new large language model (LLM) for text-to-speech that they claim exhibits "emergent" abilities. 

The 980 million parameter model, called BASE TTS, is the largest text-to-speech model yet created. The researchers trained models of various sizes on up to 100,000 hours of public domain speech data to see if they would observe the same performance leaps that occur in natural language processing models once they grow past a certain...

AWS and NVIDIA expand partnership to advance generative AI

amazon web services project ceiba nvidia re:invent generative ai artificial intelligence

Amazon Web Services (AWS) and NVIDIA have announced a significant expansion of their strategic collaboration at AWS re:Invent. The collaboration aims to provide customers with state-of-the-art infrastructure, software, and services to fuel generative AI innovations.

The collaboration brings together the strengths of both companies, integrating NVIDIA's latest multi-node systems with next-generation GPUs, CPUs, and AI software, along with AWS technologies such as Nitro System...

Amazon is building a LLM to rival OpenAI and Google

Amazon is reportedly making substantial investments in the development of a large language model (LLM) named Olympus. 

According to Reuters, the tech giant is pouring millions into this project to create a model with a staggering two trillion parameters. OpenAI’s GPT-4, for comparison, is estimated to have around one trillion parameters.

This move puts Amazon in direct competition with OpenAI, Meta, Anthropic, Google, and others. The team behind Amazon’s initiative...

Amazon invests $4B in Anthropic to boost AI capabilities

amazon anthropic ai artificial intelligence aws chatbot claude 2 model

Amazon has announced an investment of up to $4 billion into Anthropic, an emerging AI startup renowned for its innovative Claude chatbot.

Anthropic was founded by siblings Dario and Daniela Amodei, who were previously associated with OpenAI. This latest investment signifies Amazon's strategic move to bolster its presence in the ever-intensifying AI arena.

“We are excited to use AWS’s Trainium chips to develop future foundation models,” said Dario Amodei, co-founder...

AWS and Hugging Face expand partnership to make AI more accessible

Amazon Web Services (AWS) and Hugging Face have announced an expanded collaboration to accelerate the training and deployment of models for generative AI applications.

Hugging Face has as its mission the need ‘to democratise good machine learning, one commit at a time.’ The company is best known for its Transformers library for PyTorch, TensorFlow and JAX, which can support tasks ranging from natural language processing, to computer vision, to audio.

There are more...

Q&A: Felipe Chies, Amazon Web Services: Democratising ML

Amazon Web Services (AWS), the leader in public cloud infrastructure now has more than 200 fully featured services, including compute, storage, databases, networking, analytics, robotics, Internet of Things (IoT), mobile, security, hybrid, virtual and augmented reality (VR and AR), media, application development, deployment, management, and machine learning and artificial intelligence (AI). For the latter, the message is clear: AWS wants to democratise ML technologies.

AWS has the...

MIT launches cross-disciplinary program to boost AI hardware innovation

MIT has launched a new academia and industry partnership called the AI Hardware Program that aims to boost research and development.

“A sharp focus on AI hardware manufacturing, research, and design is critical to meet the demands of the world’s evolving devices, architectures, and systems,” says Anantha Chandrakasan, dean of the MIT School of Engineering, and Vannevar Bush Professor of Electrical Engineering and Computer Science. 

“Knowledge-sharing between...

Amazon will continue to ban police from using its facial recognition AI

Amazon will extend a ban it enacted last year on the use of its facial recognition for law enforcement purposes.

The web giant’s Rekognition service is one of the most powerful facial recognition tools available. Last year, Amazon signed a one-year moratorium that banned its use by police departments following a string of cases where facial recognition services – from various providers – were found to be inaccurate and/or misused by law enforcement.

Amazon has now...

AWS announces nine major updates for its ML platform SageMaker

Amazon Web Services (AWS) has announced nine major new updates for its cloud-based machine learning platform, SageMaker.

SageMaker aims to provide a machine learning service which can be used to build, train, and deploy ML models for virtually any use case.

During this year’s re:Invent conference, AWS made several announcements to further improve SageMaker’s capabilities.

Swami Sivasubramanian, VP of Amazon Machine Learning at AWS,...

NVIDIA chucks its MLPerf-leading A100 GPU into Amazon’s cloud

NVIDIA’s A100 set a new record in the MLPerf benchmark last month and now it’s accessible through Amazon’s cloud.

Amazon Web Services (AWS) first launched a GPU instance 10 years ago with the NVIDIA M2050. It’s rather poetic that, a decade on, NVIDIA is now providing AWS with the hardware to power the next generation of groundbreaking innovations.

The A100 outperformed CPUs in this year’s MLPerf by up to 237x in data centre inference. A single NVIDIA DGX A100...