NVIDIA Boosts LLM Inference Performance With New TensorRT-LLM Software Library

TensorRT-LLM provides 8x higher performance for AI inferencing on NVIDIA hardware. An illustration of LLM inferencing. Image credit: NVIDIA As companies like d-Matrix squeeze into the lucrative artificial intelligence market…

Continue ReadingNVIDIA Boosts LLM Inference Performance With New TensorRT-LLM Software Library

UK’s NCSC Warns Against Cybersecurity Attacks on AI

The National Cyber Security Centre provides details on prompt injection and data poisoning attacks so organizations using machine-learning models can mitigate the risks. Image: Michael Traitov/Adobe Stock Large language models…

Continue ReadingUK’s NCSC Warns Against Cybersecurity Attacks on AI

Generative AI and Foundation Models Face Inflated Expectations

Computer vision, data labeling and annotation, cloud AI services, and intelligence applications are the most mature applications of AI, according to Gartner's 2023 AI Hype Cycle. Image: putilov_denis/Adobe Stock Generative…

Continue ReadingGenerative AI and Foundation Models Face Inflated Expectations

OpenAI Debuts ChatGPT Enterprise, Touting Better Privacy for Business

Data from ChatGPT Enterprise will not be used to train the popular chatbot. Plus, admins can manage access. Image: gguy/Adobe Stock Today, OpenAI released ChatGPT Enterprise, an enterprise-grade version of…

Continue ReadingOpenAI Debuts ChatGPT Enterprise, Touting Better Privacy for Business