May 31, 2024 — SINGAPORE — DataRobot, the enterprise AI platform leader, today announced the integration of LLM evaluation measures aligned with a new initiative from the Singapore Government Agency, Infocomm Media Development Authority (IMDA). The “Project Moonshot” initiative unveiled at the Singapore Asia Tech x Summit offers new capabilities that help AI practitioners and system owners manage LLM deployment risks by providing a common framework for benchmarking and red teaming evaluation.

“At DataRobot, our focus is addressing the confidence gap and helping organizations scale responsible use of generative AI,” said Jay Schuren, Chief Customer Officer, DataRobot. “We’re excited to announce that our latest product release incorporates Project Moonshot’s testing toolkit and its benchmarking and evaluation tests. The result is that LLM evaluations are more accessible and help scale the responsible use of generative AI, enabling practitioners to turn on and configure guard models to change the behavior and responses of LLMs.”

Project Moonshot delivers three core capabilities for AI practitioners and system owners:

1. Automated evaluation tools for generative AI solutions that easily integrate into CI/CD pipelines.
2. A benchmark repository allowing teams to run evaluations relevant to their applications by curating the right benchmarks.
3. A one-stop tool for AI red teaming, from jailbreaks to customized attacks.

“The development of Project Moonshot, one of the world’s first open-source tools to bring red teaming, benchmarking and baseline testing together in an easy-to-use platform, would not have been possible without the contribution of partners such as DataRobot,” said Dr. Ong Chen Hui, Chair of the Governing Committee, AI Verify Foundation. “Project Moonshot will provide developers with an intuitive toolkit to test their LLM applications. This new toolkit signals Singapore’s continued commitment to advance the global open-source efforts toward addressing generative AI safety concerns.”

“We are proud to support our portfolio company, DataRobot, on its growth journey in Southeast Asia,” said Paul Ng, Chief Executive Officer, EDBI. “The company has not only expanded its footprint in Singapore but has also fostered collaborations that benefit the local innovation ecosystem, such as this partnership with IMDA. Project Moonshot provides local enterprises with the right tools to deploy generative AI technologies confidently. As a strategic investor, we are committed to creating value for our portfolio companies while enhancing Singapore’s innovation capabilities.”

DataRobot is an IMDA accredited company and a member of the AI Verify Foundation which launched the world’s first AI Governance Testing Framework and Toolkit in 2022.

To learn more about DataRobot’s latest AI observability and intervention capabilities, read our latest product announcement or visit datarobot.com.

About DataRobot 
DataRobot is the enterprise AI platform leader, empowering organizations to accelerate AI from idea to impact. With over a decade at the forefront of AI innovation, we know what it takes to make a real difference – to your bottom line, to your business vision, and to the world around us. Our end-to-end AI platform allows your organization to quickly build, securely operate and confidently govern your entire AI landscape from a single, unified experience. Organizations across industries and geographies trust DataRobot to help solve their biggest challenges with AI, leveraging generative and predictive capabilities today while providing the flexibility to adapt to the innovations of tomorrow. Learn more at datarobot.com and connect with us on LinkedIn.

About IMDA
The Infocomm Media Development Authority (IMDA) leads Singapore’s digital transformation by developing a vibrant digital economy and an inclusive digital society. As Architects of Singapore’s Digital Future, we foster growth in Infocomm Technology and Media sectors in concert with progressive regulations, harnessing frontier technologies, and developing local talent and digital infrastructure ecosystems to establish Singapore as a digital metropolis. For more news and information, visit www.imda.gov.sg or follow IMDA on Facebook (IMDAsg) and Twitter (@IMDAsg).

About EDBI
Founded in 1991, EDBI is a leading Singapore-based global investor focusing on high-growth technologies across Information & Communication Technology, Emerging Technology and Healthcare sectors. With the aim of creating long-term value and enhancing capabilities of Singapore’s key industries, we partner with companies poised for expansion in Asia and beyond, leveraging our extensive network, resources, and expertise. Explore our portfolio of successful investments and discover how we can accelerate growth together, through Singapore. Learn more at www.edbi.com.  

###

The post DataRobot Collaborates with IMDA to Make LLM Evaluation More Accessible to AI Builders with Project Moonshot appeared first on DataRobot AI Platform.

May 2, 2024 — BOSTON — DataRobot, the enterprise AI platform, today launched new AI observability functionality with real-time intervention for generative AI solutions, available across all environments including cloud, on-premise and hybrid. This latest release provides AI leaders and teams with the tools to confidently build enterprise-grade applications, manage risk and deliver business results.

“Lack of visibility and risk are significant obstacles to reaching real business value from AI,” said Venky Veeraraghavan, Chief Product Officer, DataRobot. “We’re revolutionizing AI observability with real-time intervention across diverse AI assets and environments, so leaders can safeguard projects, up-level oversight and empower teams.”

Today’s announcement brings AI observability for any AI asset and environment into the DataRobot AI Platform to deliver:

• Cross-Environment AI Observability: Gain full oversight across environments and reduce risk across your entire AI landscape with unified governance for all predictive and generative AI assets.
• Real-Time Generative AI Intervention and Moderation: Build a multilayered defense to safeguard AI applications with customized build, intervention and moderation workflows, leveraging a rich library of pre-built and configurable guards to ensure accuracy and prevent issues like prompt injections and toxicity, detect personally identifiable information (PII) and mitigate hallucinations.
• Generative AI Alerts and Diagnostics: Gain control and flexibility with customizable alert and notification policies, visually troubleshoot problems and traceback answers, and set robust multi-language diagnostics with insights for data quality checks, topic drift and more. 

“Today’s AI leaders are seeking to implement generative AI accurately, safely, and at scale,” said Amanda Saunders, Director, Enterprise Generative AI Product Marketing, NVIDIA. “DataRobot’s integrations with NVIDIA software provide enterprises with purpose-built generative AI solutions to speed successful deployments.”

This new release also introduces best-in-class evaluation, testing and open source LLM support capabilities:

• Enterprise-Grade Open Source LLM Hosting: Leverage any open source foundational model including LLaMa, Hugging Face, Falcon and Mistral with DataRobot’s built-in LLM security and resources, complementing recent integrations with NVIDIA NIM inference microservices and NVIDIA NeMo Guardrails software to accelerate AI deployments for enterprises.
• LLM Evaluations, Testing and Metrics: Enhance application quality, assess LLM performance and automate testing with groundbreaking out-of-the-box synthetic test data creation, evaluation metrics and quality benchmarks.
• Advanced RAG Experimentation: Evaluate different embedding methods, chunking strategies, and vector databases to assess and identify the best RAG strategy for each use case. 

”DataRobot is providing the requisite tools an enterprise needs to get started with generative AI quickly and with confidence,” said Ritu Jyoti, Group Vice President, Worldwide Artificial Intelligence and Automation Research Practice Global AI Research Lead, IDC. “AI leaders need to be prepared for a new normal where AI exists in multiple environments and locations. The work DataRobot is doing with AI observability sets the foundation for AI leaders and teams to thrive.”

This release is the latest milestone in DataRobot’s significant investment in generative AI for the enterprise. In the last 12 months, DataRobot introduced industry-first generative AI functionality, launched the DataRobot Generative AI Catalyst Program to jumpstart high-priority use cases, and announced new and expanded collaborations with global leaders like NVIDIA and Google Cloud to supercharge AI solutions with world-class performance and security.

All of the functionality announced today is available on cloud, on-premise, and hybrid environments. Learn more about the latest updates to the DataRobot AI Platform.

About DataRobot 
DataRobot is the leader in value-driven AI, empowering organizations to accelerate AI from idea to impact. With over a decade at the forefront of AI innovation, we know what it takes to make a real difference – to your bottom line, to your business vision, and to the world around us. Our enterprise AI platform allows your organization to quickly build, securely operate, and confidently govern your entire AI landscape from a single, unified experience. Organizations across industries and geographies trust DataRobot to help solve their biggest challenges with AI, leveraging generative and predictive capabilities today while providing the flexibility to adapt to the innovations of tomorrow. Learn more at datarobot.com and connect with us on LinkedIn.

###

The post DataRobot Introduces AI Observability with Real-Time Intervention for Generative AI appeared first on DataRobot AI Platform.

Building on the previously announced DataRobot and Google Cloud partnership to accelerate generative AI solutions, customers can now take advantage of:

• LLM blueprint strategies for 150+ models in Model Garden, including Gemini models. Leverage best-in-class foundation models in DataRobot’s LLM playground to build AI applications that are optimized for any use case, while ensuring visibility and performance.
• New solution accelerators. DataRobot AI Accelerators now include Mistral 7N and Llama 2, in addition to robust support for the Vertex AI Model Garden, empowering AI builders with expansive, flexible, and industry-tailored LLMs.

DataRobot customers are already seeing results:

• Inchcape, a leading global automotive distributor, reduced model training time by 50% and achieved an 8.1% cost reduction.
• Keller Williams increased productivity by 15% with a generative AI-powered Learning Hub personalized for their more than 187,000 real estate agents globally.
• Gannett/USA Today Network confidently applies generative AI solutions with best-in-class AI guardrails and human oversight.

“Using the DataRobot AI Platform, we’ve automated many steps in the pipeline for hundreds of models,” said Arvind Thinagarajan, VP, Data Science & Analytics, Gannett/USA Today Networks. “The synergy between Google Cloud and DataRobot helps us create a comprehensive solution for developing, deploying and managing models.”

“By working with partners like DataRobot, we are excited to continue empowering organizations with the most innovative AI solutions to suit their specific enterprise needs,” said Ritika Suri, Director of Technology Partners at Google Cloud. “With Google Cloud’s robust, advanced and Gemini-powered infrastructure, and the full AI lifecycle platform DataRobot provides, we’re enabling even more users to accelerate their AI journey and drive meaningful impact in every sector of business.”

“We’re committed to meeting our customers where they are with the world-class tools they need to confidently build, operate and govern AI,” said Raj Ramanujam, SVP, Global Channel/Tech Alliances, DataRobot. “We’re excited to deepen our partnership with Google Cloud, empowering organizations to accelerate their path to AI impact and maximize their Google Cloud investments.”

Google Cloud is a member of DataRobot Partner Ecosystem, an initiative to unify the AI landscape with the most open platform for AI. DataRobot Partner Ecosystem makes it easy to leverage cutting edge AI technology, cloud infrastructure, and applications directly within the DataRobot AI Platform — and quickly integrate with existing tools — standardizing and strengthening governance across the full AI lifecycle.

Learn more about our partnership with Google Cloud.

About DataRobot 
DataRobot is the leader in value-driven AI, empowering organizations to accelerate AI from idea to impact. With over a decade at the forefront of AI innovation, we know what it takes to make a real difference – to your bottom line, to your business vision, and to the world around us. Our open, end-to-end AI lifecycle platform allows your organization to quickly build, securely operate, and confidently govern your entire AI landscape from a single, unified experience. Organizations across industries and geographies trust DataRobot to help solve their biggest challenges with AI, leveraging generative and predictive capabilities today while providing the flexibility to adapt to the innovations of tomorrow. Learn more at datarobot.com and connect with us on LinkedIn. 

###

The post DataRobot Deepens Google Cloud Partnership with AI Solutions Powered by Google’s Gemini Models appeared first on DataRobot AI Platform.

“Organizations across industries are eager to quickly and safely deliver on AI investments with tangible, real-world value,” said Venky Veeraraghavan, Chief Product Officer, DataRobot. “Combining DataRobot’s full AI lifecycle platform and NVIDIA’s accelerated AI computing software stack and unique optimization technology, this collaboration brings together cutting-edge capabilities to enable organizations to rapidly build, confidently operate and govern AI solutions at scale to drive transformative business impact.”

This new collaboration with NVIDIA accelerates AI use case delivery. Customers can now:

Operate AI

• Deploy fully-configured generative AI models with NVIDIA NIM microservices, included with NVIDIA AI Enterprise, which are designed to accelerate the deployment of generative AI across the cloud, data center and workstations. Achieve peak performance, security and scalability with pre-built model container microservices in the DataRobot AI Platform, optimized for execution on top of NVIDIA devices. Accelerate deployment, replacement and monitoring of deep learning and LLM models on any cloud or on premises, bringing GPU-powered infrastructure to the environment that fits business needs.
• Integrate and run commercial and open-source LLMs natively on NVIDIA Triton Inference Server. Maintain full optionality while optimizing performance of GPU infrastructure.

Govern AI

• Monitor and moderate LLMs with DataRobot custom metrics and NVIDIA NeMo Guardrails. Apply NVIDIA NeMo Guardrails to DataRobot LLM blueprints to align models with safety and security requirements, or modify and combine these models with DataRobot’s custom metrics to support exact monitoring needs.

Build AI

• Compare LLM blueprint strategies in production, including NVIDIA Nemotron-3-8B LLMs. Leverage best-in-class LLMs to build generative AI applications that are uniquely tuned for an organization, with the visibility and performance needed to deliver the most optimal solution to your customers. 
• Utilize NVIDIA RAPIDS libraries within DataRobot Notebooks. Enhance end-to-end AI and data processing pipelines with a suite of GPU-accelerated data science and AI libraries to unleash development for any use case.

“Generative AI applications are key to helping businesses boost productivity with unprecedented personalization, product development and operations optimization,” said Anne Hecht, Senior Director of AI Software, NVIDIA. “DataRobot’s integrations with NVIDIA technology enhances productivity for practitioners and developers by reducing LLM deployment times from weeks to just a few minutes, maximizing inference performance efficiency and supercharging production AI for customers.”

To learn more about how DataRobot and NVIDIA are collaborating, visit https://www.datarobot.com/partners/technology-partners/nvidia.

About DataRobot:

DataRobot is the leader in value-driven AI, empowering organizations to accelerate AI from idea to impact. With over a decade at the forefront of AI innovation, we know what it takes to make a real difference – to your bottom line, to your business vision, and to the world around us. Our open, end-to-end AI lifecycle platform allows your organization to quickly build, securely operate, and confidently govern your entire AI landscape from a single, unified experience. Organizations across industries and geographies trust DataRobot to help solve their biggest challenges with AI, leveraging generative and predictive capabilities today while providing the flexibility to adapt to the innovations of tomorrow. Learn more at datarobot.com and connect with us on LinkedIn (@DataRobot).

The post DataRobot to Accelerate Enterprise-Ready AI Solutions with NVIDIA appeared first on DataRobot AI Platform.

DataRobot is proud to support the EU AI Act. We believe in the advancement of safe, secure and responsible AI. 

Every organization now faces the challenge of navigating and implementing a complex landscape of AI regulations to remain compliant. With hundreds of customers deploying and managing AI in production, we understand what it takes to govern AI safely and at scale.

DataRobot delivers best-in-class AI governance and observability, empowering organizations to maintain full visibility and oversight, mitigate risk and ensure regulatory compliance with confidence.

Here are key themes of the EU AI Act and how the DataRobot AI Platform can help your organization anticipate and accelerate compliance with the new requirements:

Risk management and comprehensive compliance

The EU AI Act categorizes AI systems into four risk levels: unacceptable, high, limited, and minimal or no risk. It mandates regular updates, real-world testing, and consideration of impacts on vulnerable groups. The AI Act also integrates with sector-specific risk management processes to ensure high-risk AI systems are safe, reliable and compliant. 

With the DataRobot AI Platform, organizations have visibility across every AI project in development, testing and production, providing a clear system of record across cloud and hybrid environments.

Monitoring, technical documentation and human oversight

Among other monitoring requirements enforced in the EU AI Act, organizations must implement proportionate post-deployment monitoring to evaluate continuous compliance of the AI system by collecting and analyzing performance data. This involves active collection, documentation, and analysis of data on performance – including interactions with other AI systems – while excluding sensitive data from law enforcement deployers. 

The DataRobot AI Platform is built to meet these requirements with advanced governance and AI monitoring capabilities. 

Our human-in-the-loop approach ensures that human oversight is maintained throughout the AI lifecycle, with intuitive interfaces and dashboards that allow stakeholders to review, understand, and manage AI systems effectively.

DataRobot also provides compliance documentation tools and professional services, such as enablement sessions and AI accelerators, to deliver complete AI oversight, enable rapid incident response, and foster cross-team collaboration.

Robust, secure and high-quality data management framework

The EU AI Act calls for the use of high-quality data sets, with a focus on robustness, accuracy and cybersecurity. 

The DataRobot AI Platform gives customers access to quality management systems and comprehensive logging capabilities, enabling organizations to maintain detailed records and remain accountable and fully transparent. 

Learn more

DataRobot is designed to help organizations manage risk, with the visibility, agility and flexibility to govern AI at scale and to meet current and evolving regulatory requirements. 

To better understand the EU AI Act and how DataRobot can support your organization, visit https://www.datarobot.com/navigating-ai-regulations-with-datarobot/.

About DataRobot 

DataRobot is the leader in value-driven AI, empowering organizations to accelerate AI from idea to impact. With over a decade at the forefront of AI innovation, we know what it takes to make a real difference – to your bottom line, to your business vision, and to the world around us. Our open, end-to-end AI lifecycle platform allows your organization to quickly build, securely operate, and confidently govern your entire AI landscape from a single, unified experience. Organizations across industries and geographies trust DataRobot to help solve their biggest challenges with AI, leveraging generative and predictive capabilities today while providing the flexibility to adapt to the innovations of tomorrow. Learn more at datarobot.com and connect with us on LinkedIn (@DataRobot).

The post DataRobot’s Response to the EU AI Act appeared first on DataRobot AI Platform.

The post DataRobot is a pureplay #AI company on a mission to democratize AI appeared first on DataRobot AI Platform.

FEBRUARY 13, 2024 – BOSTON, MA – Today, DataRobot announced it joined a new Department of Commerce initiative to support the development and deployment of trustworthy and safe AI. Established by the Department of Commerce’s National Institute of Standards and Technology (NIST), the U.S. AI Safety Institute Consortium (AISIC) will bring together leading AI stakeholders including creators and users, academics, government and industry researchers, and civil society organizations to meet this mission.

Leading the forefront of AI innovation for more than a decade, DataRobot has pioneered some of the most important applied technological advancements in AI and ML, with a focus on innovation that delivers real-world value for organizations across industries and users of all skill sets with enterprise-grade governance, safety and reliability. 

“The AISIC represents a beacon of progress to set forth a comprehensive framework and practical approach to ensure AI safety and integrity,” said Haniyeh Mahmoudian, Global AI Ethicist, DataRobot. “Our engagement in the Consortium underscores our unwavering commitment to these principles at DataRobot, and we are proud to work with our partners in government, industry, academia and civil society to support the continued development of safe and trustworthy AI.”

“The U.S. government has a significant role to play in setting the standards and developing the tools we need to mitigate the risks and harness the immense potential of artificial intelligence. President Biden directed us to pull every lever to accomplish two key goals: set safety standards and protect our innovation ecosystem. That’s precisely what the U.S. AI Safety Institute Consortium is set up to help us do,” said Gina Raimondo, U.S. Secretary of Commerce. “Through President Biden’s landmark Executive Order, we will ensure America is at the front of the pack – and by working with this group of leaders from industry, civil society, and academia, together we can confront these challenges to develop the measurements and standards we need to maintain America’s competitive edge and develop AI responsibly.”

To learn more about the U.S. AI Safety Institute Consortium, visit here.

About DataRobot:DataRobot is the Value-Driven AI company, empowering organizations to accelerate AI from idea to impact. With over a decade at the forefront of AI innovation, we know what it takes to make a real difference – to your bottom line, to your business vision, and to the world around us. Our open, end-to-end AI lifecycle platform allows your organization to quickly build, securely operate, and confidently govern your entire AI landscape from a single, unified experience. Organizations across industries and geographies trust DataRobot to help solve their biggest challenges with AI, leveraging generative and predictive capabilities today while providing the flexibility to adapt to the innovations of tomorrow. Learn more at datarobot.com and connect with us on LinkedIn (@DataRobot).

The post DataRobot Joins Department of Commerce Consortium Dedicated to AI Safety appeared first on DataRobot AI Platform.