Diagrid, provider of enterprise tools and services for building secure, reliable, and portable applications, announced details of the upcoming release of Dapr, a Cloud Native Computing Foundation project maintained by Diagrid, Microsoft, Intel, Alibaba, and others.
As organizations seek to take advantage of artificial intelligence (AI), they face a critical challenge of how to reliably customize large language models (LLMs) and integrate AI into their applications. The Dapr 1.15 new Conversation Application Programming Interface (API), will enable developers to rapidly build AI-enhanced applications powered by customized LLMs. Using the conversation API reduces the complexity of interacting with LLMs and enables critical security and reliability functions with capabilities like prompt caching and PII data obfuscation. Also, with Dapr 1.15, the Workflow API that was in beta is upgraded to production-ready status. Workflows enable developers to reliably orchestrate microservices – resulting in reliable, long-running, stateful applications.
“Developers are increasingly being tasked with customizing generic LLMs. Using Dapr, they can code workflows to reliably orchestrate retrieval augmented generation (RAG) pipelines for LLM customization, then use the conversation API to query the LLM, with built-in prompt caching,” said Mark Fussell, co-creator of Dapr and CEO of Diagrid. “An additional benefit of Dapr is that it protects developers as AI technology evolves so it’s possible to switch one LLM technology for another with zero impact on the application. As enterprises strive to maintain competitiveness, architecting AI into applications so it can evolve is critical.”
Also Read: NetApp and Red Hat Team Up to Increase Flexibility in Virtual Environments
The CNCF announced Tuesday that the Dapr project achieved graduation from its previous incubation status. Graduation is the highest level a project can attain in CNCF and indicates broad user adoption and maturity. In order to achieve this milestone, Dapr was recognized for its: strong committee governance; security as a fundamental consideration; excellent documentation and contribution guidelines; and an open, engaging community. Tens of thousands of organizations use Dapr to run mission critical applications. Go here to read the blog post with more information.
Also, last week Dapr was named a finalist in the InfoWorld Technology of the Year awards in the “Software Development: Tools” category.
KubeCon attendees can hear more about Dapr 1.15 by attending this session presented by Diagrid chief technology officer and Dapr co-creator Yaron Schneider. Also, Hugo Smitter, senior architect with credit-scoring company FICO, has two sessions talking about use of Dapr to increase deployment flexibility and velocity, as well as building high-scale event-driven applications.
SOURCE: BusinessWire