More security for generative AI and LLMs

More security for generative AI and LLMs

Share post

Companies cannot afford to ignore generative AI and its potential. However, you need comprehensive AI observability to ensure investments in generative AI are successful and risks are avoided.

Dynatrace has expanded its analytics and automation platform to include holistic observability and security for LLMs and generative AI-powered applications. Dynatrace AI Observability enables companies worldwide to use generative AI reliably and cost-effectively to increase their innovation, productivity and sales.

The most important platforms are supported

Dynatrace AI Observability is a comprehensive solution. It covers the end-to-end AI stack, including infrastructure like Nvidia GPUs, foundational models like GPT4, semantic caches and vector databases like Weaviate, and orchestration frameworks like LangChain. Additionally, Dynatrace AI Observability supports major platforms for building, training, and deploying AI models, including Microsoft Azure OpenAI Service, Amazon SageMaker, and Google AI Platform.

Dynatrace AI Observability leverages Davis AI and other core platform technologies to provide an accurate and comprehensive view of AI-driven applications. This allows companies to provide an excellent user experience while automatically identifying performance bottlenecks and their causes. Dynatrace AI Observability with Davis AI also helps comply with privacy and security policies and governance standards by accurately tracking the provenance of data generated by applications. In addition, companies get help in forecasting and controlling costs with the Dynatrace platform monitoring token consumption. Tokens form the basic units that generative AI models use to process requests.

Companies have increasing interest in generative AI

Gartner predicts that AI adoption will result in more than 2028 percent of cloud computing resources being used for AI workloads by 50, up from less than 10 percent in 2023. This growth reflects, in part, increasing interest Companies are embracing the use of generative AI to improve efficiency and productivity, drive automation and drive innovation. Despite this dynamic, many companies are also concerned about the costs associated with generative AI-powered services. These can be many times higher than with conventional cloud services and are difficult to predict. They are based on the consumption of generative AI tokens by applications that are not yet in production. At the same time, governments around the world are introducing regulations to regulate the use of AI technologies in a responsible and ethical manner and in compliance with applicable laws.

“Generative AI is the new frontier for digital transformation,” says Bernd Greifeneder, CTO at Dynatrace. “This technology enables companies to develop innovative solutions that increase productivity, profitability and competitiveness. As it drives transformation, new challenges arise in security, transparency, reliability, experience and cost management. To overcome these challenges, companies need an AI observability capability that covers every aspect of their generative AI solutions. Dynatrace is expanding its market leadership in observability and AI to meet this need and help customers confidently and securely use AI with deep insights into their generative AI-driven applications.”

Generative AI is driving productivity worldwide

“Generative and predictive AI will open up new possibilities for our business activities with our ML and LLM services. However, to implement them successfully, we must ensure that our services that support these critical workloads are reliable and perform well,” said Ryan Berry, SVP Engineering & Architecture at OneStream. “That’s why we rely on Dynatrace. Our teams use Dynatrace to develop and optimize generative AI apps that perform well, are cost-effective to manage, and deployable at scale.”

“AI-powered transformation is a key driver of productivity and competitiveness for businesses worldwide,” said Ali Dalloul, VP, AI, Microsoft. “Microsoft Azure OpenAI Service is a robust generative AI solution for enterprises and public institutions around the world. We are pleased to partner with Dynatrace, a leading provider of AI-powered observability. This enables our mutual customers and their teams driving innovation across the world's largest organizations to build generative AI-based services with Azure Open AI Service and Dynatrace AI Observability. This powerful combination helps ensure these services achieve the highest standards of security, reliability and performance, while allowing the teams managing them to control costs.”

More at Dynatrace.com

 


About Dynatrace

Dynatrace ensures that software works perfectly worldwide. Our unified software intelligence platform combines broad and deep observability and continuous run-time application security with the most advanced AIOps to deliver answers and intelligent automation from data at remarkable scale. This enables organizations to modernize and automate cloud operations, deliver software faster and more securely, and ensure flawless digital experiences.


Matching articles on the topic

Cybersecurity platform with protection for 5G environments

Cybersecurity specialist Trend Micro unveils its platform-based approach to protecting organizations' ever-expanding attack surface, including securing ➡ Read more

Data manipulation, the underestimated danger

Every year, World Backup Day on March 31st serves as a reminder of the importance of up-to-date and easily accessible backups ➡ Read more

Printers as a security risk

Corporate printer fleets are increasingly becoming a blind spot and pose enormous problems for their efficiency and security. ➡ Read more

The AI ​​Act and its consequences for data protection

With the AI ​​Act, the first law for AI has been approved and gives manufacturers of AI applications between six months and ➡ Read more

Windows operating systems: Almost two million computers at risk

There are no longer any updates for the Windows 7 and 8 operating systems. This means open security gaps and therefore worthwhile and ➡ Read more

AI on Enterprise Storage fights ransomware in real time

NetApp is one of the first to integrate artificial intelligence (AI) and machine learning (ML) directly into primary storage to combat ransomware ➡ Read more

DSPM product suite for Zero Trust Data Security

Data Security Posture Management – ​​DSPM for short – is crucial for companies to ensure cyber resilience against the multitude ➡ Read more

Data encryption: More security on cloud platforms

Online platforms are often the target of cyberattacks, such as Trello recently. 5 tips ensure more effective data encryption in the cloud ➡ Read more