AI

Using Spectrum fine-tuning to improve FM training efficiency on Amazon SageMaker AI

Optimizing generative AI applications relies on tailoring foundation models (FMs) using techniques such as prompt engineering, RAG, continued pre-training, and fine-tuning. Efficient fine-tuning is achieved by strategically managing hardware, training time, data volume, and model quality to reduce resource demands and maximize value. Spectrum is a new approach designed to pinpoint the most informative layers […]

Using Spectrum fine-tuning to improve FM training efficiency on Amazon SageMaker AI Read More »

HyperPod enhances ML infrastructure with security and storage

Amazon SageMaker HyperPod is a purpose-built infrastructure for optimizing foundation model training and inference at scale. SageMaker HyperPod removes the undifferentiated heavy lifting involved in building and optimizing machine learning (ML) infrastructure for training foundation models (FMs). As AI moves towards deployment adopting to a multitude of domains and use cases, the need for security

HyperPod enhances ML infrastructure with security and storage Read More »

MIT Energy Initiative conference spotlights research priorities amidst a changing energy landscape

“We’re here to talk about really substantive changes, and we want you to be a participant in that,” said Desirée Plata, the School of Engineering Distinguished Professor of Climate and Energy in MIT’s Department of Civil and Environmental Engineering, at Energizing@MIT: the MIT Energy Initiative’s (MITEI) Annual Research Conference that was held on Sept. 9-10.

MIT Energy Initiative conference spotlights research priorities amidst a changing energy landscape Read More »

MIT Energy Initiative conference spotlights research priorities amidst a changing energy landscape

“We’re here to talk about really substantive changes, and we want you to be a participant in that,” said Desirée Plata, the School of Engineering Distinguished Professor of Climate and Energy in MIT’s Department of Civil and Environmental Engineering, at Energizing@MIT: the MIT Energy Initiative’s (MITEI) Annual Research Conference that was held on Sept. 9-10.

MIT Energy Initiative conference spotlights research priorities amidst a changing energy landscape Read More »

Accelerating generative AI applications with a platform engineering approach

Over the past two years, I’ve worked with many customers using generative AI to transform their organizations. Most stall at experimentation, because costs stack up and timelines extend before delivering demonstrable value. A 2023 AWS MIT Chief Data Officer (CDO) Symposium survey backs this up, reporting that while 71% of Chief Data Officers were experimenting

Accelerating generative AI applications with a platform engineering approach Read More »