• Falcon 180B, the most advanced open Large Language Model (LLM) is available via Amazon SageMaker Jumpstart

Dubai, UAE – In a monumental stride for the Middle East's technology landscape, Amazon Web Services, Inc. (AWS), an Amazon.com, Inc. company, announced that Abu Dhabi's Technology Innovation Institute (TII), the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), has made a groundbreaking advancement in the field of artificial intelligence by making its Falcon 180B large language model available for deployment on Amazon's SageMaker JumpStart platform. This release signifies an industry milestone, as Falcon 180B is not only the largest openly available language models with 180 billion parameters, but it is also backed by an exhaustive 3.5-trillion-token dataset. This robust model represents a scaled-up version of TII’s previous Falcon 40B model, employing sophisticated technologies such as multi-query attention for enhanced scalability.

Trained on a cluster of nearly 4,000 A100 GPUs, Falcon 180B is finely tuned to work seamlessly with the Amazon SageMaker environment. The use of Amazon Simple Storage Service (Amazon S3) for data storage and checkpoint management ensures both workload reliability and ease of operations. Additionally, TII has rolled out an early chat – specialized  version, Falcon 180B-Chat, which has been custom-tailored to excel in conversational applications. Both these models are deployed in a rigorously secure AWS environment that operates under Virtual Private Cloud (VPC) protocols, thereby offering enhanced data protection for users.

For those keen to explore Falcon 180B, the model is discoverable and ready for deployment within the SageMaker Studio via Amazon SageMaker JumpStart. In line with TII’s philosophy of responsible innovation, the model is released under the Falcon-180B TII License and Acceptable Use Policy for responsible AI use. Benchmark tests affirm the model's commanding performance, ranking it between GPT-3.5 and GPT-4 across various language understanding and generation metrics.

Dr. Ebtesam Almazrouei, Executive Director – Acting Chief AI Researcher of AI Cross Center Unit and Project Lead for LLM Projects at TII said: " By offering Falcon 180B as an open-access tool, we're laying the groundwork for organizations to harness its unparalleled functionalities and pave the way for future progress and transformative solutions in AI. Our pursuit of scientific knowledge should always be in service of the greater good, and open sourcing this technology allows us to democratize its benefits, foster collaboration, and ensure transparency. We are elated to provide Falcon180B platform that we believe will catalyze groundbreaking advancements in both academic research and industry solutions"

The responses from experts were positive. Huggingface scientist, Clémentine Fourrier, mentioned the model’s memory efficiency, highlighting  that users could reduce memory needs by 75% without damaging the inference quality.

Advancing the Boundaries of Large Language Models

AI cross center unit in TII chose Amazon SageMaker to build its Falcon 180B model, which positioned them as a top technology enabler for their dedication to innovative solutions. With Falcon 180B, UAE is advancing the boundaries of large language models and advancing the field of AI. Its radical capabilities and open accessibility has the potential to reshape multiple industries and stimulate innovation on a global scale.

Moreover, Falcon 180B training has offered TII important experience in high-performance infrastructure in addition to boosting their dataset resources for upcoming research and development initiatives.

TII announced its Falcon 180B model in September, 2023 under the Falcon-180B TII License. Falcon 180B has outperformed contemporary models in multiple benchmarks with little to no fine-tuning. Amazon SageMaker Jumpstart makes Falcon 180B easier for customers to access where customers of any size and industry can quickly and easily deploy their own Falcon 180B model and customise it for translation, question answering, summarising information, or identifying images. 

Wojciech Bajda, Managing Director – Public Sector Middle East and Africa at AWS, said:  "Working in tandem with the Technology Innovation Institute to bring Falcon 180B to life using Amazon SageMaker has been a journey marked by numerous milestones – technological innovation, academic excellence, efficient training processes, and operational ease of use. Today's milestone of open Falcon 180B's integration into Amazon SageMaker JumpStart is not just a triumph for TII but also a proud moment for technological innovation in the Middle East.”

With Falcon LLM 180B, organizations worldwide can access its advanced tech capabilities and empower researchers to drive innovation in AI. For further information and a step-by-step guide on how to deploy Falcon 180B, you may refer to AWS’ detailed blog post:  Falcon 180B foundation model from TII is now available via Amazon SageMaker JumpStart

About Amazon Web Services

Since 2006, Amazon Web Services has been the world’s most comprehensive and broadly adopted cloud. AWS has been continually expanding its services to support virtually any workload, and it now has more than 240 fully featured services for compute, storage, databases, networking, analytics, machine learning and artificial intelligence (AI), Internet of Things (IoT), mobile, security, hybrid, virtual and augmented reality (VR and AR), media, and application development, deployment, and management from 102 Availability Zones within 32 geographic regions, with announced plans for 12 more Availability Zones and four more AWS Regions in Canada, Malaysia, New Zealand, and Thailand. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—trust AWS to power their infrastructure, become more agile, and lower costs. To learn more about AWS, visit aws.amazon.com.

About Amazon

Amazon is guided by four principles: customer obsession rather than competitor focus, passion for invention, commitment to operational excellence, and long-term thinking. Amazon strives to be Earth’s Most Customer-Centric Company, Earth’s Best Employer, and Earth’s Safest Place to Work. Customer reviews, 1-Click shopping, personalized recommendations, Prime, Fulfillment by Amazon, AWS, Kindle Direct Publishing, Kindle, Career Choice, Fire tablets, Fire TV, Amazon Echo, Alexa, Just Walk Out technology, Amazon Studios, and The Climate Pledge are some of the things pioneered by Amazon. For more information, visit amazon.com/about and follow @AmazonNews.