Improving Just Walk Out technology with multi-sensory AI | Amazon Web Services Machine Learning Blog

Just Walk Out Technology Revolutionizing Shopping

Since Amazon introduced the Just Walk Out technology in 2018, it has revolutionized the shopping experience by allowing customers to pick items and leave without standing in line to pay. This checkout-free system is now available in over 180 third-party locations worldwide, spanning various industries from travel retailers to college campuses.

The Next Generation Just Walk Out Technology

The latest generation of Just Walk Out technology by Amazon is powered by a multi-modal foundation model (FM), specially designed for physical stores. This FM utilizes a transformer-based architecture similar to those in generative AI applications and incorporates data from various sources such as video cameras, weight sensors on shelves, floor plans, and product images.

Enhancing Accuracy and Scalability

The multi-modal FM enhances the Just Walk Out system’s capabilities by enabling it to handle complex real-world shopping scenarios with greater accuracy and lower costs. Unlike previous modular architectures, this new model can effectively generalize to new store formats, products, and customer behaviors through continuous learning.

Training and Infrastructure

To train the FM effectively, a robust infrastructure was built leveraging Amazon Web Services (AWS) such as Amazon S3 for data storage and Amazon SageMaker for training. The model’s accuracy is continually refined by incorporating high-quality and challenging data into the training set, ensuring its applicability across diverse physical store environments.

Pioneering End-to-End AI Systems

The innovative multi-modal AI system represents a shift towards simpler and more scalable AI models that can be trained end-to-end, eliminating the need for human-defined subcomponents and interfaces. This approach not only enhances the accuracy of the receipt system but also opens up new possibilities for improving the shopping experience at Just Walk Out technology stores globally.

Image: [Insert relevant image here]

[Diagram: Displaying the process of training the FM effectively.]

Through the advancements in multi-modal AI, the Just Walk Out technology is set to enhance customer experiences at more locations across the world, marking a significant step in the evolution of retail technology.