The Cloudcast

Massive Studios

The Cloudcast (@cloudcastpod) is the industry's #1 Cloud Computing podcast, and the place where Cloud meets AI.  Co-hosts Aaron Delp (@aarondelp) & Brian Gracely (@bgracely) speak with technology and business leaders that are shaping the future of business. Topics will include Cloud Computing | AI | AGI | ChatGPT | Open Source | AWS | Azure | GCP | Platform Engineering | DevOps | Big Data | ML | Security | Kubernetes | AppDev | SaaS | PaaS .

read less
テクノロジーテクノロジー

エピソード

AI for the Legal industry
2日前
AI for the Legal industry
Jay Madheswaran (Founder & CEO @ Eve) talks about bringing AI to the legal vertical and the intersection of AI/ML of increased efficiency for legal firms.SHOW: 857SHOW TRANSCRIPT: The Cloudcast #857 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"SHOW NOTES:Eve HomepageTopic 1 - Welcome to the show. Before we jump into the legal industry and AI, let’s talk a little bit about your background. Give everyone a brief introduction.Topic 2 - What made you focus on the legal industry? When I think of forward leaning industries that quickly adopt new technologies, I don’t think of legal. What are the most common use cases?Topic 3 - Tell us a little bit about the tech behind the scenes. Do you use foundational models and then fine-tune them? Do you have your own custom models? What are your thoughts on the current state and future of models for specific industries or verticals?Topic 4 - Legal is a highly regulated space; how do your customers (law firms) think about data security and compliance? Tell everyone a bit about how all of this works.Topic 5 - Do your clients use RAG for custom information that needs to be brought into the models? How does all of that work for customer data?Topic 6 - When I think about legal, I think about two big areas. We covered compliance and the financial side of this, but what about the billing and financial side? How is ROI on legal AI calculated? Where and how does a legal AI help? Is this measured in hours saved, which translates into dollars saved?Topic 7 - Let’s close by discussing the people aspect. We keep hearing AI is going to take everyone’s jobs away. What are your thoughts on how this supplements vs. replace staff?FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
Understanding the Gartner perspective on Cloud (and more)
04-09-2024
Understanding the Gartner perspective on Cloud (and more)
Paul Delory (@pacdelory, Research VP @Gartner_Inc for Technical Professionals) shares insights about cloud computing, cloud costs, VMware, Platform engineering and IaC.SHOW: 853CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SHOW NOTES:On The CUBE discussing VMware in April: https://www.youtube.com/watch?v=-wIClYI6bDQSoftware Development Times discussion Platform Engineering: https://sdtimes.com/softwaredev/analyst-view-whats-new-whats-now-and-whats-next-in-platform-engineering/Topic 1 - Welcome to the show. Before we jump into a broad set of topics today, give us a little bit about your background and what you focus on today.Topic 2 - The hyperscalers have grown quite large over the last decade, but as we came out of COVID, many of their customers were concerned about the cost of cloud. Are we seeing a new rationalization coming around cloud costs and accountability of costs? Topic 3 - We’ve all read the headlines regarding changes to VMware by Broadcom. Alternatives to VMware would be big decisions for many companies. As a neutral independent, how are you framing your thinking about the VMware ecosystem and the decisions being made about the future of virtualization? Topic 4 - Over the last decade, we’ve seen so many new technologies. To get value from them, they require more cross-functional collaboration. These days we tend to call that Platform Engineering. How well do you see the evolution of people and processes being adopted, and how much more needs to happen?Topic 5 - Behind the scenes of every transition over the past decade (Cloud, AI, Cloud-native) is the adoption of automation. This seems like a no-brainer, but actual adoption is lumpy across companies. What are some of the hard parts of automation that aren’t discussed enough? FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
The Cloudcast #852 - Slow Data, Fast Data and Adapting AI models for your business
01-09-2024
The Cloudcast #852 - Slow Data, Fast Data and Adapting AI models for your business
With so much rapid change happening around AI models, is there a framework for when to build models, train models, fine-tune models, use RAG or something else? Let’s explore…SHOW: 852SHOW TRANSCRIPT: The Cloudcast #852 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK:  http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST:  "CLOUDCAST BASICS"SHOW SPONSOR:Access Gartner cloud research come to life with the “The Future of Cloud in 2028: From Technology to Business Necessity,” webinar.Secure your seat for Gartner IT Infrastructure, Operations & Cloud Strategies Conference 2024 with our early bird savings of $400 off standard rates now.  Upgrade to the next generation of the cloud.  Oracle Cloud InfrastructureSHOW NOTES:What is Retrieval Augmented Generation (RAG)?Fine-Tuning vs. RAGPredictive AI vs. Generative AIAndrew Ng (always worth a watch IMO) https://youtu.be/sal78ACtGTc?si=dCoKXb5o4KB2XSerHarrison Chase (LangChain) https://youtu.be/pBBe1pk8hf4?si=lAit69_pDeRKcBGqhttps://blog.langchain.dev/what-is-a-cognitive-architecture/https://thenewstack.io/lets-get-agentic-langchain-and-llamaindex-talk-ai-agents/https://www.youtube.com/watch?v=N-IYzyi86yYhttps://blog.langchain.dev/what-is-an-agent/https://www.microsoft.com/en-us/research/project/autogen/https://www.crewai.com/ HOW SHOULD WE DECIDE WHICH AI MODEL TO USE FOR OUR APPLICATION?Build, buy, use open source, augment with your own data - so many decisionsHow often do you update models with new data? HOW DO WE BRING OUR COMPANY DATA / KNOWLEDGE TO OUR AI MODELS?Large Static Models - Predictive AILLMs + Slow-Changing Data - Align the ModelLLMs + Fast-Changing Data - RAGLLMs + Agent-Learned Data - Agentic AIFEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
How DevOps is helping to rethink the need for VPNs with Modern Security
28-08-2024
How DevOps is helping to rethink the need for VPNs with Modern Security
Emrul Islam (Head of Platform Innovation @TwingateHQ) talks about the evolution of remote access, application security, and enabling DevOps teams to drive security transformation.  SHOW: 851SHOW TRANSCRIPT: The Cloudcast #851 TranscriptCLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS" SHOW NOTES:How Twingate WorksTwingate vs. VPNsArchitecting Network Connectivity for a Zero Trust FutureSolving the usability problem to unlock Zero Trust adoptionReddit link: https://www.reddit.com/r/twingate/ Signup for Twingate for freeTopic 1 - Welcome to the show. Topic 2 - To properly solve cloud access & security pain points, companies need a tool that works for IT, DevOps, & Security teamsWhat are the challenges when trying to secure cloud access today?What role do each of the stakeholders play in addressing these?How much can technology really help address these challenges?Topic 3 - How is Twingate architected differently to address these new challenges?How do existing systems work?What sort of architecture is required?Topic 4 - Why is it a struggle to get these teams aligned on the right solutionIs there a disconnect between competing requirements and security?Topic 5 - What is the opportunity for Devops teams to influence remote access and security architecture?Why automate security?How much can be automated?FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
The Scale of Cloud Networking
21-08-2024
The Scale of Cloud Networking
Vinay Tripathi (Senior Member of IEEE,  Production Network Engineer @Google) talks about the evolution of backbone networks for the Cloud and Internet, future technologies and career opportunities. SHOW: 849SHOW TRANSCRIPT: The Cloudcast #849 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"SHOW NOTES:Topic 1 - Welcome to the show. Before we jump into cloud networking, let’s talk a little bit about your background and some of the areas you focus on today. Topic 2 - Let’s start with something big - the anatomy of cloud backbone networks. What is the makeup of a typical cloud backbone network?Topic 3 - What are some of the unique challenges and solutions that you need to think about in terms of scaling, reliability, securing, and maintaining these massive networks, along with the innovative solutions being implementedTopic 4 - Looking forward, what are some of the emerging trends like intent driven networks, software defined global WAN, and the impact of AI/ML on cloud backbone infrastructure.Topic 5 - Some people in the networking industry are concerned about the future of network engineers. Career Paths in Cloud Networking: skills and knowledge required for a successful career in this field, along with potential career paths.FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
Reflections on the Cloud Evolution - with a special guest
18-08-2024
Reflections on the Cloud Evolution - with a special guest
The summer lull has us reflecting on how the evolution of cloud computing has shaped the existing era that’s trying to figure out AI. With a special guest introduction. SHOW: 848SHOW TRANSCRIPT: The Cloudcast #848 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST:  "CLOUDCAST BASICS"SHOW NOTES:WE HAVE A SPECIAL GUEST LEADING OFF THE SHOW - AFTER 13 YEARSWHAT PARTS OF THE CLOUD EVOLUTION HAVE LAID THE FOUNDATION FOR TODAY?[BAD] Shadow IT set Enterprise IT back 5-10 years, with the same responsibilities[GOOD] Technology experimentation has become the norm, from technologists to business leaders. [BAD] We still don’t really know how to measure the cost or return (ROI) of technology spending.[GOOD] We have a new appreciation for the power of software and software development to change businesses and markets.[BAD] But we still haven’t figured how to normalize great software development[GOOD] Open source communities (e.g. CNCF, etc.) provided a blueprint for bringing new innovation to the marketplace[BAD] We saw how long it took for Cloud to be disruptive, but now that valuations are so high, we haven’t learned patience for new disruptions.[GOOD] The “cloud” way of doing things has laid the foundation for what might/will come next. FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
Data Center Buildouts for AI
14-08-2024
Data Center Buildouts for AI
Scott Jarnagin (Founder/CEO of Caddis Cloud Solutions (Caddis Cloud Solutions)) talks about the challenges of building modern data centers to handle the growing demands of AI. SHOW: 847SHOW TRANSCRIPT: The Cloudcast #847 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK:  http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST:  "CLOUDCAST BASICS" SHOW NOTES:Caddis Cloud Solutions (homepage)Topic 1 - Welcome to the show. Before we jump into Caddis Cloud, let’s talk a little bit about your background and then what led you to start  the company. Topic 2 - Let’s begin by looking at the bigger picture intersection of today’s data centers and the growing demand for AI capabilities. How much of a change will current data centers have to go through to be able to support AI at any sort of scale?Topic 3 - How are cloud providers, hosting companies and enterprises evolving to meet the increased demands driven by AI and other high-intensity computing processes?Topic 4 - How would you typically advise an enterprise to think about matching the AI needs to the current and future capabilities of the market? How do they make sure their AI plans aren’t going to get sidetracked with the wrong datacenter/cloud choice?Topic 5 - Are there elements of government development/involvement for datacenter expansion that companies should be aware of as they make future plans around AI? Topic 6 - How frameworks does Caddis Cloud typically use to help guide companies that are looking at near-term and long-term data center plansFEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
The Evolution of Data Platforms
31-07-2024
The Evolution of Data Platforms
Jeff Denworth, (@JeffDenworth, Co-Founder of @VAST_Data) talks about building data platforms for new AI application demands. SHOW: 843SHOW TRANSCRIPT: The Cloudcast #843 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK:  http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS"SHOW SPONSOR:Upgrade to the next generation of the cloud.  Oracle Cloud InfrastructureSHOW NOTES:VAST Data (homepage)Understanding AI IO performance (whitepaper)Topic 1 - Welcome to the show. Before we jump into VAST Data, let’s talk a little bit about your background and then what led you to start  the company. Topic 2 - As we talk about datacenter or cloud architectures, right now GPUs are king. This is causing a complete rethinking of data center architectures. But what is this doing to the storage side of the equation? Topic 3 - To a certain extent (in the context of AI), GPUs are this massive change from CPUs in that cost almost isn’t considered because of the great fear of falling behind in AI model building/usage. But storage has always been a performance+price discussion. Does that discussion still exist when companies must choose all-flash storage to keep up with GPU IO demands?Topic 4 - We’ve obviously seen a lot of new innovation around GenAI models over the last couple years, but what have you seen from Enterprise companies in terms of real adoption, AI use-cases, etc? Topic 5 - How are you finding Enterprise companies balancing the current requirements around infrastructure modernization (maybe driven by new VMware licensing, etc.) with AI demands? Topic 6 - Do you find that data platform teams are having to make many adjustments to their environments or skills, especially since all-flash technology has been around for at least a decade?FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
Enabling Voice AI in Applications
24-07-2024
Enabling Voice AI in Applications
Scott Stephenson (@deepgramscott, CEO of @deepgram) talks about building Voice AI into your applications.SHOW: 841SHOW TRANSCRIPT: The Cloudcast #841 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK:  http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST:  "CLOUDCAST BASICS" SPONSOR NOTES:Upgrade to the next generation of the cloud.  Oracle Cloud InfrastructureSHOW NOTES:Deepgram (homepage)Topic 1 - Welcome to the show. Before we jump into Deepgram and Voice AI, let’s talk a little bit about your background and then what led you to start the company.Topic 2 - Let’s start by stepping back and looking at the bigger picture. Many of us have interacted with voice technologies, from Siri to Alexa to various call-center “agents”. From a maturity perspective, where are we in terms of voice-centric interactions with computing systems? Topic 3 - When businesses think about including computer-aided voice-centric interactions to their applications, what’s the typical thought process for where it makes sense to the business, how it represents their brand, etc.?Topic 4 - How does Deepgram bring Voice AI to applications? What do developers have to think about when adding Voice AI to an existing application, or to think about building a voice-centric application from the start?Topic 5 - What are some of the most common use-cases when Voice AI adds new value to the application? What areas are starting to push the edges of possible? Topic 6 - How do companies usually go about collecting user-feedback about the voice-centric interactions?Topic 7 - If you look forward a year or two, where do you see Voice AI types of technologies evolving? FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
The Mid Year (2024) Mailbag
17-07-2024
The Mid Year (2024) Mailbag
2024 has been evolving very quickly for Cloud and AI. So as we get to the mid-year point, we stop and answer many of your mailbag questions. SHOW: 839SHOW TRANSCRIPT: The Cloudcast #839 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS"SHOW NOTES:Amazon acqui-hiring - Adept.ioInflectionAmazon building ChatGPT Competitorhttps://www.businessinsider.com/amazon-andy-jassy-wooed-wall-street-overhauled-bloated-tech-giant-2024-7The InfraRed ReportMAILBAG QUESTIONS:Topic 1 - At this stage of the GenAI era, obviously the “picks and shovels” are winning (e.g. NVIDIA). But beyond that, are there obvious winners and losers, or areas that look more promising? Topic 2 - In the near-term or long-term, do you think there will be big differentiation in the LLM models, or do they eventually commoditized? Topic 3 - There is some talk that Amazon (&/or) AWS are behind in GenAI, but obviously they are ahead with cloud. Do you think GenAI offerings will be enough to get companies to move clouds, or will it just be another cloud workload and companies already use multiple clouds? Topic 4 - Do you have any thoughts about how GenAI (or any AI) will impact IT architectural thinking over the next couple of years? Topic 5 - Do you think the recent rounds of layoffs, or slow downs in hiring, will have a big impact on IT organizations?Topic 6 - What happens if GenAI doesn’t turn out to be as successful as so many people are forecasting? What happens to all the other potential technology innovations while that plays out?Topic 7 - If you were advising someone on a tech career choice in 2024, what type of guidance would you give someone? Topic 8 - DevOps had a long run as “the IT cultural change” for a while. Do you see any of the other tech/culture trends starting to get more popular (FinOps, Platform Engineering, MLOps, etc.)?FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod