<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[ricchapman.ai]]></title><description><![CDATA[Practical intelligence for modern IT leaders navigating the age of AI]]></description><link>https://newsletter.ricchapman.ai</link><image><url>https://substackcdn.com/image/fetch/$s_!K21Y!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e3ea09d-8aad-46c4-b487-c5d8830d7ecf_1024x1024.png</url><title>ricchapman.ai</title><link>https://newsletter.ricchapman.ai</link></image><generator>Substack</generator><lastBuildDate>Mon, 01 Jun 2026 01:37:40 GMT</lastBuildDate><atom:link href="https://newsletter.ricchapman.ai/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Ric Chapman]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[ricchapmanai@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[ricchapmanai@substack.com]]></itunes:email><itunes:name><![CDATA[Ric Chapman]]></itunes:name></itunes:owner><itunes:author><![CDATA[Ric Chapman]]></itunes:author><googleplay:owner><![CDATA[ricchapmanai@substack.com]]></googleplay:owner><googleplay:email><![CDATA[ricchapmanai@substack.com]]></googleplay:email><googleplay:author><![CDATA[Ric Chapman]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[The Build #001: Understanding the Data (CRISP-DM)]]></title><description><![CDATA[Your first hands-on session using a realistic IT dataset, designed to build practical AI intuition and set the foundation for future engineering exercises.]]></description><link>https://newsletter.ricchapman.ai/p/the-build-001-understanding-the-data</link><guid isPermaLink="false">https://newsletter.ricchapman.ai/p/the-build-001-understanding-the-data</guid><dc:creator><![CDATA[Ric Chapman]]></dc:creator><pubDate>Thu, 11 Dec 2025 09:02:13 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!vfoz!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Welcome to the first edition of <strong>The Build</strong>, a weekly practical series created to help IT leaders and curious practitioners deepen their technical understanding of AI. In my recent <a href="https://newsletter.ricchapman.ai/p/closing-the-ai-skills-gap-a-practical">skills gap article</a>, I talked about why leaders benefit from getting closer to the mechanics of AI. When you understand what&#8217;s happening under the hood, your strategic thinking changes, your conversations improve, and you become far more credible when shaping AI direction inside the business.</p><p>This series exists to help you build that confidence one practical step at a time.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.ricchapman.ai/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Enjoying The Build? Subscribe to get each hands-on AI session delivered straight to your inbox, every week.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>I&#8217;ve said many times that <strong>data is the starting point of AI</strong>. Universities treat it as foundational, most AI courses open with it, and nearly every real-world AI project begins with understanding the data before doing anything else. You&#8217;ll see why quickly. Without understanding your data, everything that follows becomes guesswork. </p><p>Over the coming weeks, we&#8217;ll work through practical exercises that mirror real AI engineering work: data exploration, feature creation, model behaviour, evaluation techniques, notebook workflows, and more. But before we ever talk about models, we have to start where every real AI project starts: <strong>with the data</strong>.</p><p>To do this properly, we&#8217;re going to anchor this edition in the <strong>CRISP-DM</strong> process, the same structured framework used by data scientists and AI teams across the industry.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!vfoz!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!vfoz!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png 424w, https://substackcdn.com/image/fetch/$s_!vfoz!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png 848w, https://substackcdn.com/image/fetch/$s_!vfoz!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png 1272w, https://substackcdn.com/image/fetch/$s_!vfoz!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!vfoz!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png" width="947" height="588" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:588,&quot;width&quot;:947,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:80231,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.ricchapman.ai/i/181275344?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!vfoz!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png 424w, https://substackcdn.com/image/fetch/$s_!vfoz!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png 848w, https://substackcdn.com/image/fetch/$s_!vfoz!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png 1272w, https://substackcdn.com/image/fetch/$s_!vfoz!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e26064e-3b10-4a62-9a16-1ceb1a8aee32_947x588.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The <strong>Cross Industry Standard Process for Data Mining</strong> was developed by a consortium of companies involved in Data Mining (Chapman et al, <a href="https://www.scirp.org/reference/referencespapers?referenceid=1592779">https://www.scirp.org/reference/referencespapers?referenceid=1592779</a>). Most people use some variation of this model, but it is foundational in that sense, and everyone agrees on the first three steps.</p><p><strong>CRISP-DM</strong> lists the first three stages of any data or AI project as:</p><ol><li><p><strong>Business Understanding</strong></p></li><li><p><strong>Data Understanding</strong></p></li><li><p><strong>Data Preparation</strong></p></li></ol><p>Those first two steps occur before any technical work begins. We&#8217;ll cover business understanding, then move into more hands-on data understanding before moving into data preparation.  Data preparation can be an exhaustive topic, so we&#8217;ll dig deeper into it as part of <strong>The Build</strong> series of articles.</p><p>To make this as realistic as possible, we&#8217;ll work with a synthetic yet life-like CSV dataset containing IT service desk records. This dataset is sufficiently large and diverse to support a range of practical applications. Over time, we&#8217;ll take this same dataset through the entire <strong>CRISP-DM</strong> lifecycle: exploration, preparation, modelling, evaluation, and deployment.  </p><p>The data was generated with AI, so any similarity to real people, events, or that one time your service desk melted down on a Friday afternoon is purely coincidental. </p><p>For now, we&#8217;ll cover the importance of business understanding before taking the very first practical step: <strong>load the data, explore it, and understand what story it&#8217;s trying to tell</strong>.</p><p>Don&#8217;t worry if <strong>Jupyter</strong>, <strong>Python</strong>, or <strong>pandas</strong> are new to you. Everything will be explained clearly, and you&#8217;ll be able to follow along without any prior experience.</p><div><hr></div><h2>Business Understanding: CRISP-DM Step 1</h2><p>Before touching a single line of code, we need to understand <strong>why</strong> we&#8217;re looking at this data and what problem we are trying to solve. CRISP DM starts with Business Understanding for a simple reason: without a clear purpose, even the most elegant analysis becomes meaningless.</p><p>We&#8217;re grounding this first Build in a familiar domain, the IT service desk. Because service desks are ubiquitous across most organisations, their data provides a realistic, relatable environment for learning core AI and data concepts.</p><p>This step focuses on connecting data to the <em>real</em> work of IT leadership. Service desk data reflects:</p><ul><li><p>User friction and productivity loss</p></li><li><p>Operational bottlenecks</p></li><li><p>System reliability</p></li><li><p>Team workload and skills distribution</p></li><li><p>Service quality and customer experience</p></li><li><p>Potential risks brewing beneath the surface</p></li></ul><p>In short, this dataset represents the day-to-day operational heartbeat of IT. And as an IT or AI tech leader, you likely already have a strong intuitive sense of this landscape. That&#8217;s useful, but it won&#8217;t always hold in other business domains. In finance, logistics, marketing, HR, procurement, or CX, you may not instinctively understand why specific data exists or what influences it.</p><p>That&#8217;s why <strong>Business Understanding</strong> matters. When you&#8217;re in an unfamiliar domain, your first step is always to speak with people who <em>live</em> that process daily. Their knowledge shapes the questions you ask and prevents you from misinterpreting the data.</p><p>For service desk data, typical leadership questions include:</p><ul><li><p>Where are we seeing the most operational friction?</p></li><li><p>Which teams are under pressure and why?</p></li><li><p>Are we meeting service expectations?</p></li><li><p>What problems are emerging that we haven&#8217;t spotted yet?</p></li><li><p>Which areas or departments consistently generate the most demand?</p></li></ul><p>These questions provide direction and help us stay anchored as we move deeper into the technical stages of CRISP-DM.</p><h2>Data Understanding: CRISP-DM Step 2</h2><p>With a clear purpose established, we move into <strong>Data Understanding</strong>, the stage where we begin exploring what the dataset contains. This isn&#8217;t about fixing anything yet. It&#8217;s about becoming familiar with the raw material.</p><p>Think of this as the reconnaissance phase. You&#8217;re not drawing conclusions; you&#8217;re building intuition.</p><p>At this stage, leaders and analysts should be asking themselves:</p><ul><li><p><strong>What kinds of data do we have?</strong> Dates, categories, text, numbers?</p></li><li><p><strong>Is the dataset complete?</strong> Are there missing values or inconsistent fields?</p></li><li><p><strong>How is the data distributed?</strong> Are some categories dominant? Are some rarely used?</p></li><li><p><strong>What early patterns stand out?</strong> Do some departments log far more tickets? Are specific priorities overused?</p></li><li><p><strong>Does anything look unusual or suspicious?</strong> Strange timestamps, oddly frequent categories, or priority patterns that don&#8217;t match real-world experience.</p></li></ul><p>Data Understanding is about seeing the data <em>as it really is</em>, not how we expect or want it to be. This step helps you:</p><ul><li><p>Spot problems early (inconsistencies, missing values, odd behaviour).</p></li><li><p>Identify which parts of the dataset will matter most later.</p></li><li><p>Develop a mental model of what the analysis or AI model may reveal.</p></li><li><p>Avoid costly mistakes in interpretation.</p></li></ul><p>By clarifying the terrain, we set ourselves up for the next stage: <strong>Data Preparation</strong>, where we begin shaping and refining the dataset to make it meaningful, reliable, and ready for deeper exploration.</p><p>Now that we&#8217;ve grounded ourselves conceptually, we can move on to the practical exploration of the dataset.</p><h3>Downloadable Resources</h3><p>To follow along, you will need:</p><ul><li><p><a href="https://drive.google.com/file/d/1l4eKYKtMhvDKwnxySfegKnevhQ2yLPIj/view?usp=sharing">service_desk_dataset.csv</a>, the full synthetic dataset</p></li><li><p><a href="https://drive.google.com/file/d/10CVlkIHCmqk4sFa-LfYZoDZlR3u0NsUf/view?usp=sharing">the_build_001.ipynb</a>, notebook with exploration steps</p></li></ul><div><hr></div><h2>Step 1. Introducing the Dataset</h2><p>Here is the dataset we&#8217;ll use throughout <strong>The Build</strong> series. It contains thousands of synthetic service desk tickets designed to resemble real organisational data. This version has been deliberately created with <strong>richness</strong>, <strong>imperfections</strong>, and <strong>inconsistencies</strong>, because real-world data is rarely clean. These imperfections provide ample opportunities for data cleansing, transformation, simplification, and feature engineering.</p><p>Below is a summary of all dataset columns to help you quickly understand what each feature represents and how it will be used throughout this series.</p><h4>Ticket Metadata</h4><p><strong>ticket_id</strong><br>Unique identifier for each ticket.</p><p><strong>opened_datetime</strong><br>Timestamp when the ticket was created.</p><p><strong>closed_datetime</strong><br>Timestamp when the ticket was resolved (may be missing).</p><p><strong>sla_target_hours</strong><br>Allowed resolution time based on ticket priority.</p><p><strong>reopened</strong><br>Indicates whether the ticket was reopened after closure.<br></p><h4>User and Department Information</h4><p><strong>user_department</strong><br>Department of the user, including intentional spelling mistakes and variations.</p><p><strong>user_role</strong><br>User&#8217;s role or seniority (Employee, Manager, Director, Executive, Contractor).</p><p><strong>customer_type</strong><br>Whether the user is Internal or External.</p><p><strong>location</strong><br>Office or region. Includes duplicates such as Manchester and Manchester Office.<br></p><h4>Ticket Classification</h4><p><strong>priority</strong><br>Importance of the ticket (Low, Medium, High, Critical).</p><p><strong>urgency_level</strong><br>Secondary urgency measure (Low, Medium, High, Severe).</p><p><strong>issue_severity</strong><br>Severity rating (1 - Critical, 2 - High, etc.).</p><p><strong>category</strong><br>Issue type (Password reset, VPN problem, Application error, etc.).</p><p><strong>system_affected</strong><br>Business or technical system impacted (Email, CRM, HR System, etc.).</p><p><strong>device_type</strong><br>Device involved (Laptop, Desktop, Mobile, Tablet, Virtual Machine).<br></p><h4>Operational Handling</h4><p><strong>assigned_team</strong><br>Team responsible for handling the issue.</p><p><strong>channel</strong><br>Method used to raise the ticket (Email, Phone, Portal, Chat).</p><p><strong>ticket_source</strong><br>Additional source detail (Walk-in, Monitoring Alert, Self-Service).</p><p><strong>follow_up_required</strong><br>Indicates whether further action is needed after closure.</p><p><strong>resolution_notes</strong><br>Short summary of the resolution outcome.<br></p><h4>Text Content</h4><p><strong>ticket_description</strong><br>Free-text description of the issue. Useful for natural language processing.<br></p><h4>Asset and System Metadata</h4><p><strong>asset_id</strong><br>Identifier for the affected device or system component.</p><div><hr></div><h2>Step 2. Installing Jupyter</h2><p>Before we jump into installation, it&#8217;s worth explaining <strong>what Jupyter is and why it&#8217;s widely used</strong> in both business and academic settings.</p><h3>What is Jupyter?</h3><p>Jupyter is an interactive environment that lets you write and run code in small, manageable blocks called <em>cells</em>. Each cell can contain Python code, text, visuals, tables, or charts. Instead of writing a complete program and running it all at once, Jupyter lets you iterate step by step, see results immediately, and experiment quickly.</p><p>Think of it as a digital lab notebook for data work.</p><h3>Why is Jupyter so popular?</h3><p>Jupyter has become the default tool for:</p><ul><li><p><strong>Data science:</strong> Analysts, engineers, and AI practitioners use it to explore data, test ideas, and build models.</p></li><li><p><strong>Machine learning experimentation:</strong> Most model prototypes start life in a Jupyter notebook because it&#8217;s fast to iterate.</p></li><li><p><strong>Business analytics:</strong> Dashboards, reports, and exploratory analysis often begin in Jupyter before being handed off to BI tools.</p></li><li><p><strong>Academia and research:</strong> Universities use Jupyter to teach programming, statistics, AI, and scientific computing because it&#8217;s beginner-friendly and powerful.</p></li><li><p><strong>Reproducibility and collaboration:</strong> A notebook shows not only the final output but also every step required to get there. This makes work easy to review, share, and explain.</p></li></ul><h3>Why are we using Jupyter in The Build?</h3><p>Because it is:</p><ul><li><p><strong>Beginner-friendly</strong> &#8211; you can run one cell at a time.</p></li><li><p><strong>Immediate</strong> &#8211; you see results instantly.</p></li><li><p><strong>Flexible</strong> &#8211; perfect for combining explanations, code, and outputs.</p></li><li><p><strong>Industry standard</strong> &#8211; if you learn Jupyter, you&#8217;re learning in the same environment as data scientists and AI engineers.</p></li></ul><p>You don&#8217;t need prior experience. By the end of this series, you&#8217;ll be comfortable running Python, exploring data, and building your own workflows inside a notebook.</p><p>We can now discuss how to install it.</p><p><strong>Installing Jupyter</strong></p><p>Before we load any data, you&#8217;ll need a working Jupyter environment. The easiest and most common way to get Jupyter running on your machine is through <strong>Anaconda</strong>, which packages Python, Jupyter Notebook, and many useful scientific libraries into a single installer.</p><p>Rather than walk through the installation step by step for each operating system (Windows, macOS, and Linux), the most reliable approach is to follow Anaconda&#8217;s official guides. These guides are regularly updated and tailored to your specific OS.</p><p>You can find them here:</p><p><strong>Official Anaconda Installation Guides</strong><br><a href="https://www.anaconda.com/download">https://www.anaconda.com/download</a></p><p>Choose your operating system, follow the steps, and once installed, you&#8217;ll be able to launch <strong>Jupyter Notebook</strong> directly from the Anaconda Navigator.</p><p>Once Jupyter is installed and running, we can begin working with the dataset.</p><div><hr></div><h2>Step 3. Load the Data in Jupyter</h2><p>Let&#8217;s start to get our hands dirty. The key here is not to panic if Jupyter is new to you. It is simple to learn, and we will keep this first session deliberately light. You are encouraged to experiment, break things, and re-run cells. That is often the best way to learn.</p><p>Open a Jupyter Notebook and run the following by clicking inside the cell and pressing <strong>Ctrl+Enter</strong> if you&#8217;re using Windows (or the equivalent key combination for your operating system):</p><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!SNJm!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff36d3d0a-9693-4cc4-8301-b99cfe6263b1_643x226.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!SNJm!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff36d3d0a-9693-4cc4-8301-b99cfe6263b1_643x226.png 424w, https://substackcdn.com/image/fetch/$s_!SNJm!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff36d3d0a-9693-4cc4-8301-b99cfe6263b1_643x226.png 848w, https://substackcdn.com/image/fetch/$s_!SNJm!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff36d3d0a-9693-4cc4-8301-b99cfe6263b1_643x226.png 1272w, https://substackcdn.com/image/fetch/$s_!SNJm!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff36d3d0a-9693-4cc4-8301-b99cfe6263b1_643x226.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!SNJm!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff36d3d0a-9693-4cc4-8301-b99cfe6263b1_643x226.png" width="643" height="226" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f36d3d0a-9693-4cc4-8301-b99cfe6263b1_643x226.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:226,&quot;width&quot;:643,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:22058,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.ricchapman.ai/i/181275344?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff36d3d0a-9693-4cc4-8301-b99cfe6263b1_643x226.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!SNJm!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff36d3d0a-9693-4cc4-8301-b99cfe6263b1_643x226.png 424w, https://substackcdn.com/image/fetch/$s_!SNJm!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff36d3d0a-9693-4cc4-8301-b99cfe6263b1_643x226.png 848w, https://substackcdn.com/image/fetch/$s_!SNJm!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff36d3d0a-9693-4cc4-8301-b99cfe6263b1_643x226.png 1272w, https://substackcdn.com/image/fetch/$s_!SNJm!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff36d3d0a-9693-4cc4-8301-b99cfe6263b1_643x226.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><h3><br>What this does</h3><ul><li><p><code>import pandas as pd</code> - loads the <strong>pandas</strong> library, which gives us powerful tools for working with tabular data.</p></li><li><p><code>df = pd.read_csv(&#8221;service_desk_dataset.csv&#8221;)</code> - reads the CSV file into a <strong>DataFrame</strong> called <code>df</code>.</p></li><li><p><code>df.head()</code> - displays the first five rows, allowing you to visually confirm that the data has loaded correctly.</p></li></ul><h3>How to interpret the output</h3><p>You should see a small preview of your dataset, with column names across the top and a few rows below. This is your first chance to spot:</p><ul><li><p>Obvious errors</p></li><li><p>Strange or unexpected values</p></li><li><p>Missing timestamps</p></li><li><p>Odd-looking departments, locations, or categories</p></li></ul><p>Please don&#8217;t worry about fixing anything yet. At this stage, we are simply getting familiar with the shape and feel of the data.</p><div><hr></div><h2>Step 4. Explore the Data</h2><p>Understanding your dataset means asking the simplest possible questions first. In this step, we are not trying to build models or produce polished reports. We are just trying to understand what we are dealing with.</p><h3>How big is it?</h3><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!pEou!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9d50da6-0596-4ec7-a41a-d23d013b0d1c_642x129.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!pEou!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9d50da6-0596-4ec7-a41a-d23d013b0d1c_642x129.png 424w, https://substackcdn.com/image/fetch/$s_!pEou!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9d50da6-0596-4ec7-a41a-d23d013b0d1c_642x129.png 848w, https://substackcdn.com/image/fetch/$s_!pEou!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9d50da6-0596-4ec7-a41a-d23d013b0d1c_642x129.png 1272w, https://substackcdn.com/image/fetch/$s_!pEou!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9d50da6-0596-4ec7-a41a-d23d013b0d1c_642x129.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!pEou!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9d50da6-0596-4ec7-a41a-d23d013b0d1c_642x129.png" width="642" height="129" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a9d50da6-0596-4ec7-a41a-d23d013b0d1c_642x129.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:129,&quot;width&quot;:642,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:6832,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.ricchapman.ai/i/181275344?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9d50da6-0596-4ec7-a41a-d23d013b0d1c_642x129.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!pEou!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9d50da6-0596-4ec7-a41a-d23d013b0d1c_642x129.png 424w, https://substackcdn.com/image/fetch/$s_!pEou!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9d50da6-0596-4ec7-a41a-d23d013b0d1c_642x129.png 848w, https://substackcdn.com/image/fetch/$s_!pEou!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9d50da6-0596-4ec7-a41a-d23d013b0d1c_642x129.png 1272w, https://substackcdn.com/image/fetch/$s_!pEou!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9d50da6-0596-4ec7-a41a-d23d013b0d1c_642x129.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p><strong>What this does</strong></p><p>Returns a tuple in the form <code>(rows, columns)</code>.</p><p><strong>How to interpret it</strong></p><p>If you see (1500, 25), it means 1,500 records and 25 features. This tells you:</p><ul><li><p>There is enough data to see patterns.</p></li><li><p>There are plenty of features to work with.</p></li><li><p>Cleansing and preparation will matter.</p></li></ul><h3>What types of data does it contain?</h3><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!wGUc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc17cdd02-b7e6-4b83-bf5b-a30172824e0a_642x133.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!wGUc!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc17cdd02-b7e6-4b83-bf5b-a30172824e0a_642x133.png 424w, https://substackcdn.com/image/fetch/$s_!wGUc!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc17cdd02-b7e6-4b83-bf5b-a30172824e0a_642x133.png 848w, https://substackcdn.com/image/fetch/$s_!wGUc!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc17cdd02-b7e6-4b83-bf5b-a30172824e0a_642x133.png 1272w, https://substackcdn.com/image/fetch/$s_!wGUc!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc17cdd02-b7e6-4b83-bf5b-a30172824e0a_642x133.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!wGUc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc17cdd02-b7e6-4b83-bf5b-a30172824e0a_642x133.png" width="642" height="133" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c17cdd02-b7e6-4b83-bf5b-a30172824e0a_642x133.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:133,&quot;width&quot;:642,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:6751,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.ricchapman.ai/i/181275344?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc17cdd02-b7e6-4b83-bf5b-a30172824e0a_642x133.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!wGUc!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc17cdd02-b7e6-4b83-bf5b-a30172824e0a_642x133.png 424w, https://substackcdn.com/image/fetch/$s_!wGUc!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc17cdd02-b7e6-4b83-bf5b-a30172824e0a_642x133.png 848w, https://substackcdn.com/image/fetch/$s_!wGUc!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc17cdd02-b7e6-4b83-bf5b-a30172824e0a_642x133.png 1272w, https://substackcdn.com/image/fetch/$s_!wGUc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc17cdd02-b7e6-4b83-bf5b-a30172824e0a_642x133.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p><strong>What this does</strong></p><p>Shows each column, its data type, and how many non-null values it contains.</p><p><strong>How to interpret it</strong></p><p>This is one of the most critical early commands. You can quickly see:</p><ul><li><p>Which columns have missing values</p></li><li><p>Which columns are stored as text when they might represent dates or numbers</p></li><li><p>Whether any fields look suspicious (for example, a column that is almost entirely empty)</p></li></ul><p>This is often where data quality issues first reveal themselves.</p><h3>What do the numbers look like?</h3><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!AQzZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8477224c-67fd-4c7d-8647-a020ef6391a5_640x131.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!AQzZ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8477224c-67fd-4c7d-8647-a020ef6391a5_640x131.png 424w, https://substackcdn.com/image/fetch/$s_!AQzZ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8477224c-67fd-4c7d-8647-a020ef6391a5_640x131.png 848w, https://substackcdn.com/image/fetch/$s_!AQzZ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8477224c-67fd-4c7d-8647-a020ef6391a5_640x131.png 1272w, https://substackcdn.com/image/fetch/$s_!AQzZ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8477224c-67fd-4c7d-8647-a020ef6391a5_640x131.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!AQzZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8477224c-67fd-4c7d-8647-a020ef6391a5_640x131.png" width="640" height="131" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8477224c-67fd-4c7d-8647-a020ef6391a5_640x131.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:131,&quot;width&quot;:640,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:8171,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.ricchapman.ai/i/181275344?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8477224c-67fd-4c7d-8647-a020ef6391a5_640x131.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!AQzZ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8477224c-67fd-4c7d-8647-a020ef6391a5_640x131.png 424w, https://substackcdn.com/image/fetch/$s_!AQzZ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8477224c-67fd-4c7d-8647-a020ef6391a5_640x131.png 848w, https://substackcdn.com/image/fetch/$s_!AQzZ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8477224c-67fd-4c7d-8647-a020ef6391a5_640x131.png 1272w, https://substackcdn.com/image/fetch/$s_!AQzZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8477224c-67fd-4c7d-8647-a020ef6391a5_640x131.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p><strong>What this does</strong></p><p>Produces summary statistics for numeric columns: count, mean, standard deviation, minimum, maximum, and common percentiles.</p><p><strong>How to interpret it</strong></p><p>Look for:</p><ul><li><p>Very large spreads between minimum and maximum values</p></li><li><p>Unusual averages</p></li><li><p>SLA targets or numeric fields that do not look realistic</p></li></ul><p>This gives you a sense of whether the numbers in your dataset behave as you would expect.</p><h3>What are the most common categories?</h3><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Iqbu!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ebe72fb-54ef-4f38-b7ab-adc3305ce2fc_639x129.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Iqbu!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ebe72fb-54ef-4f38-b7ab-adc3305ce2fc_639x129.png 424w, https://substackcdn.com/image/fetch/$s_!Iqbu!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ebe72fb-54ef-4f38-b7ab-adc3305ce2fc_639x129.png 848w, https://substackcdn.com/image/fetch/$s_!Iqbu!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ebe72fb-54ef-4f38-b7ab-adc3305ce2fc_639x129.png 1272w, https://substackcdn.com/image/fetch/$s_!Iqbu!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ebe72fb-54ef-4f38-b7ab-adc3305ce2fc_639x129.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Iqbu!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ebe72fb-54ef-4f38-b7ab-adc3305ce2fc_639x129.png" width="639" height="129" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1ebe72fb-54ef-4f38-b7ab-adc3305ce2fc_639x129.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:129,&quot;width&quot;:639,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:11407,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.ricchapman.ai/i/181275344?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ebe72fb-54ef-4f38-b7ab-adc3305ce2fc_639x129.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Iqbu!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ebe72fb-54ef-4f38-b7ab-adc3305ce2fc_639x129.png 424w, https://substackcdn.com/image/fetch/$s_!Iqbu!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ebe72fb-54ef-4f38-b7ab-adc3305ce2fc_639x129.png 848w, https://substackcdn.com/image/fetch/$s_!Iqbu!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ebe72fb-54ef-4f38-b7ab-adc3305ce2fc_639x129.png 1272w, https://substackcdn.com/image/fetch/$s_!Iqbu!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1ebe72fb-54ef-4f38-b7ab-adc3305ce2fc_639x129.png 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a></figure></div><p><strong>What this does</strong></p><p>Shows the most common values in the <code>category</code> column.</p><p><strong>How to interpret it</strong></p><p>This helps you understand:</p><ul><li><p>The types of issues users most frequently report</p></li><li><p>Where operational pressure may be highest</p></li><li><p>Which categories might be worth simplifying or grouping later</p></li></ul><p>This kind of simple frequency analysis is often enough to start useful leadership conversations.</p><p>This is the heart of the Data Understanding stage in CRISP-DM: examining the data as it is, not as you assume it should be. No cleaning yet. No assumptions. No transformations. You are simply learning what you have.</p><div><hr></div><h2>Step 5. Early Observations</h2><p>When you explore a new dataset, you should start forming observations such as:</p><ul><li><p>Are specific departments logging far more tickets?</p></li><li><p>Are priorities evenly distributed or skewed?</p></li><li><p>Are some categories extremely rare or extremely common?</p></li><li><p>Are there fields that look incomplete or inconsistent?</p></li><li><p>Do timestamps look valid and complete?</p></li></ul><p>These aren&#8217;t conclusions, only early impressions. But they matter because they guide the next CRISP DM stage: <strong>data preparation</strong>.</p><p>Next week&#8217;s Build will take this dataset further by preparing and simplifying the features so we can begin extracting insights.</p><div><hr></div><h2>Downloadable Resources</h2><p>To follow along, you will need:</p><ul><li><p><a href="https://drive.google.com/file/d/1l4eKYKtMhvDKwnxySfegKnevhQ2yLPIj/view?usp=sharing">service_desk_dataset.csv</a>, the full synthetic dataset</p></li><li><p><a href="https://drive.google.com/file/d/10CVlkIHCmqk4sFa-LfYZoDZlR3u0NsUf/view?usp=sharing">the_build_001.ipynb</a>, notebook with exploration steps</p></li></ul><div><hr></div><p>Many AI projects fail not because the model is poor, but because the data was never appropriately understood in the first place. CRISP-DM prioritises data understanding over preparation, modelling, or experimentation. Everything that happens later, the insights, the predictions, the automation, even the storytelling, depends on the quality of thinking you apply here.</p><p>If you can understand the data, you can understand the problem. Once you understand the problem, every decision downstream becomes clearer. You know what to clean. You know what to transform. You know which features matter. You know which questions are worth answering. Without that foundation, even the best tools and algorithms will struggle to deliver value.</p><p>This first edition of <strong>The Build</strong> may feel gentle, but it sets the tone for everything that follows. You&#8217;ve taken the same first steps as data scientists, analysts, and AI engineers on real projects: grounding the work in a business context, exploring raw data, and forming early intuition about what&#8217;s happening beneath the surface.</p><p>That intuition doesn&#8217;t just make you better at working with AI; it makes you better at <em>leading</em> the people who work with AI.</p><p>Strong leadership in AI isn&#8217;t about out-coding your data scientists or being the technical expert in every conversation. It&#8217;s about understanding enough of the process to:</p><ul><li><p>Ask sharper, more relevant questions.</p></li><li><p>Challenge assumptions with confidence.</p></li><li><p>Spot risks earlier.</p></li><li><p>Understand what &#8220;good&#8221; looks like in analysis and modelling.</p></li><li><p>Provide clearer direction to business analysts and data scientists.</p></li><li><p>Build trust by speaking their language without overwhelming them with detail.</p></li></ul><p>When you understand the early stages of CRISP DM, especially Business Understanding and Data Understanding, you see the world through the same lens your analysts and data scientists do. You appreciate the complexity they manage, the constraints they navigate, and the thinking behind their recommendations. This builds stronger collaboration, sharper decision-making, and far more effective leadership.</p><p>Next week, we move into <strong>Data Preparation</strong>, the stage where the dataset stops being something you <em>look at</em> and becomes something you <em>shape</em>. We&#8217;ll clean the data, engineer useful features, simplify complexity, and prepare the foundation for more advanced techniques in future Builds.</p><p>This is where the raw material starts turning into something powerful.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.ricchapman.ai/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Enjoying The Build? Subscribe to get each hands-on AI session delivered straight to your inbox, every week.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Closing the AI Skills Gap: A Practical Guide for IT Leaders]]></title><description><![CDATA[Building the technical fluency modern IT leadership demands.]]></description><link>https://newsletter.ricchapman.ai/p/closing-the-ai-skills-gap-a-practical</link><guid isPermaLink="false">https://newsletter.ricchapman.ai/p/closing-the-ai-skills-gap-a-practical</guid><dc:creator><![CDATA[Ric Chapman]]></dc:creator><pubDate>Tue, 09 Dec 2025 09:40:53 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!K21Y!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4e3ea09d-8aad-46c4-b487-c5d8830d7ecf_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>For most of us in IT leadership, our careers were built on solid technical ground. I started as a junior web designer before moving into technical support, then infrastructure engineering, and eventually into roles where the remit widened, and the responsibility shifted from doing the work to shaping the work and supporting the people delivering it. That&#8217;s where the fundamental shift began into leadership, influence, and the slow but steady development of strategic thinking.</p><p>The early years mattered. They gave me the technical depth to understand how systems fit together and the practical experience to deliver projects that grew from minor fixes to major rollouts. They also forced me to develop the skill of taking something deeply technical and explaining it clearly to people who don&#8217;t live and breathe IT and networks. Critical in developing the nuance for leadership.</p><p>Backgrounds like ours create credible strategic thinkers because we understand the technology intimately and can articulate the concepts that matter.</p><p>But AI has disrupted that entire progression. It arrived fast, it arrived hard, and crucially, it arrived after most IT leaders had already made their way up the ladder. There was no &#8220;junior AI engineer&#8221; phase to grow through. No years of hands-on modelling, data wrangling or algorithmic debugging to draw on. And yet we&#8217;re now being asked to make high-impact strategic decisions about technologies we never had the chance to learn from the ground up.</p><p>My goal here is to give IT leaders a practical, non-academic bridge into the technical foundations of AI: the concepts you genuinely need to understand to think strategically, communicate confidently and lead effectively in a world shaped by intelligent systems.</p><p>In this article, we&#8217;ll cover the following:</p><ol><li><p>Why Technical AI Literacy Matters for Strategic Thinkers</p></li><li><p>Data Quality and Availability</p></li><li><p>Algorithmic Behaviour and Limitations</p></li><li><p>Python Literacy and Technical Fluency</p></li><li><p>Model Performance Over Time</p></li><li><p>Organisational Readiness and Change</p></li><li><p>Ethics, Governance and Accountability</p></li><li><p>Cost, Compute and Scaling Decisions</p><p></p></li></ol><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.ricchapman.ai/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Get practical AI leadership insights straight to your inbox.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><h2>1. Why Technical AI Literacy Matters for Strategic Thinkers</h2><p>Many IT leaders find themselves in a strange position. They&#8217;re experienced, credible, and technically seasoned, but when it comes to AI, they&#8217;re missing the foundational knowledge that enables strategic thinking. Without that literacy:</p><ul><li><p>Conversations with vendors can feel lopsided.</p></li><li><p>Internal discussions become abstract.</p></li><li><p>Risk assessments lose precision.</p></li></ul><p>Decision-making slows, confidence slips, and influence weakens.</p><p>Most IT teams today are also operating leaner than ever. Years of cost-cutting and efficiency drives have created environments where engineering capacity is tight, specialist roles are rare, and AI expertise is often entirely absent. Even competent teams struggle to take on deep data work or machine learning operations when they&#8217;re already stretched keeping the lights on.</p><p>Hiring externally can help fill those gaps, but it won&#8217;t remove the need for technical understanding at the leadership level. You can bring in data scientists, ML engineers or AI architects, but if you can&#8217;t evaluate their proposals, challenge their assumptions or steer their priorities, you&#8217;re not leading the capability. You&#8217;re depending on it.</p><p>Modern AI teams need leaders who understand enough to guide, question, and support them. Without that literacy, even the best hires will struggle to deliver meaningful impact.</p><p>This is where the requirement for authentic leadership emerges. You can&#8217;t lead what you don&#8217;t understand, and you certainly can&#8217;t influence what you can&#8217;t explain. Strategic influence depends on one thing above all else: the ability to clearly articulate <strong>why</strong> a technology matters and <strong>how</strong> it works at a functional level.</p><ul><li><p>If you can&#8217;t explain a concept, you can&#8217;t evaluate it.</p></li><li><p>If you can&#8217;t evaluate it, you can&#8217;t guide a strategy.</p></li><li><p>If you can&#8217;t guide a strategy, you lose authority in the room.</p></li></ul><p>AI magnifies this because so much of it sounds too good to be true, and alongside industry thought leaders confusing the picture with doomsday scenarios and workforce replacement, taking the lead and projecting confidence is hard work. Leaders who lack technical grounding end up relying on vendors, consultants, or enthusiastic internal teams to &#8220;explain&#8221; things, leaving you constantly feeling on the back foot.</p><h3>AI strategy requires a different type of intelligence</h3><p>Traditional IT strategy was built on clear, tangible components, infrastructure, applications, budgets and risk. These were domains you could map, measure, and diagram, often with predictable cause-and-effect.</p><p>AI strategy breaks that mould entirely. Instead of neat architectural layers, you&#8217;re dealing with moving parts that influence each other in ways that aren&#8217;t always obvious. It lives at the intersection of:</p><ul><li><p>Data quality and availability</p></li><li><p>Algorithmic behaviour and limitations</p></li><li><p>Python literacy and technical fluency</p></li><li><p>Model performance over time</p></li><li><p>Organisational readiness and change</p></li><li><p>Ethics, governance and accountability</p></li><li><p>Cost, compute and scaling decisions</p></li></ul><p>These aren&#8217;t topics you can delegate blindly. You can&#8217;t treat AI as a black box handled by a specialist team or an external partner. To lead effectively, you need enough technical understanding to see how these pieces fit together, where the constraints are and which trade-offs actually matter. IT leaders who can do that shape the strategy. IT leaders who can&#8217;t will end up reacting to it.</p><h3>Credibility comes from fluency, not code</h3><p>Here&#8217;s the good news:</p><p>You don&#8217;t need to become a data scientist.<br>You don&#8217;t need to write machine learning models.<br>You don&#8217;t need to memorise equations.</p><p>But you <strong>do</strong> need fluency.</p><p>You need to understand the concepts behind the buzzwords. You need to be able to challenge assumptions, ask the right questions and see where the risks hide.</p><p>When you understand AI at a technical-but-leader-friendly level, everything becomes easier:</p><ul><li><p>Vendor conversations shift from sales-led to strategic.</p></li><li><p>Project planning becomes realistic and outcome-focused.</p></li><li><p>Governance discussions become grounded instead of speculative.</p></li><li><p>The board sees you as the authority rather than the messenger.</p></li></ul><div><hr></div><h2>2. Data Quality and Availability</h2><p>Before leaders can understand algorithms, tooling or architecture, they must start with the element that shapes every AI outcome: data. AI systems don&#8217;t learn from strategy decks, vendor demos or organisational ambition. They learn from data, the patterns within it, the gaps between it, and the reliability of how it&#8217;s collected and maintained.</p><p>If the data is weak, the AI will be weak. If the data is inconsistent, the AI will be erratic. Nothing in the stack compensates for poor data. This is why data quality and availability sit at the top of the technical literacy ladder.</p><p>When I began my Master&#8217;s in AI, this fact hit me almost immediately. In our first foundational Data Science module, the message was unmistakable: <strong>models aren&#8217;t intelligent, they&#8217;re obedient</strong>. They learn exactly what the data teaches them, no more, no less. Every project, no matter how advanced, started with days of cleaning, validating and reshaping data before anyone even mentioned algorithms. It was a humbling reminder that the glamorous part, the modelling, is only as good as the groundwork beneath it.</p><p>And that&#8217;s the blind spot for many organisations. They assume data issues are minor, technical nuisances, the kind of thing an engineer can &#8220;tidy up later&#8221;. But AI exposes everything: the messy fields, the legacy migrations, the half-completed records, the conflicting definitions. What humans quietly compensate for, AI faithfully amplifies.</p><p>Take a straightforward example. A customer dataset where a client appears under three slightly different spellings across two systems. A human recognises they&#8217;re the same person. An AI model doesn&#8217;t. It treats them as three individuals, distorting churn predictions, customer value scoring, and personalised recommendations, all because of one governance issue ignored for years.</p><p>The same applies to operational processes. If ticket categories are inconsistently logged, an AI assistant trained to help your service desk won&#8217;t magically repair the inconsistencies. It will confidently produce incorrect classifications due to the chaos it inherited. The issue wasn&#8217;t the model. It was the data.</p><p>Leaders don&#8217;t need to write ETL (Extract, Transform, Load) pipelines or design schemas, but they do need to understand the signals of good data. They need to be able to ask:</p><ul><li><p>Where does this dataset come from?</p></li><li><p>Who owns its quality?</p></li><li><p>How clean and consistent is it, really?</p></li><li><p>Is the lineage understood?</p></li><li><p>Can we trust this for automated decisions?</p></li></ul><p>This isn&#8217;t technical trivia. These questions determine whether an AI initiative succeeds or quietly unravels.</p><p>Data isn&#8217;t static either. It decays as processes shift, behaviours evolve and systems age. That means data quality cannot be treated as a project with a beginning and an end. It must be treated as infrastructure, continuously monitored, maintained, and governed.</p><p>Good AI begins long before a model is trained. It starts with data that is accurate, consistent, complete and available. Leaders who understand this don&#8217;t just build better AI; they prevent entire categories of failure before they occur.</p><h2>3. Algorithmic Behaviour and Limitations</h2><p>Algorithms were another reality check early in my Master&#8217;s. Before the course, I assumed algorithms were the clever bit, the secret sauce that made AI powerful. The first few weeks completely dismantled that idea. Algorithms aren&#8217;t intelligent. They don&#8217;t reason, interpret or understand. They pattern, match, faithfully and rigidly, even when the pattern no longer makes any sense.</p><p>This is where many leaders misjudge them. Humans use context, intuition and lived experience. Algorithms use maths. They don&#8217;t understand meaning, intent or tone; they reflect statistical relationships in their training data. Two people can read the same customer email and instantly understand the underlying frustration, sarcasm or urgency. A model might classify the same message as positive because it spotted a single upbeat word.</p><p>One exercise during the module drove this home. We trained a classifier on an imbalanced dataset, and the model ended up predicting the majority class almost every time. On paper, its accuracy looked impressive. In practice, it was useless. It wasn&#8217;t broken; it was doing precisely what the data had taught it. That lesson matters for leadership: AI isn&#8217;t just capable of being wrong, it can be confidently wrong in ways a human would never be.</p><p>Real systems behave the same way. A customer support classifier might latch onto misleading keywords and repeat the mistake indefinitely. A forecasting model might miss a market shift because it has no concept of external forces. A fraud model might flag legitimate behaviour simply because it has never seen it before. These aren&#8217;t failures of intelligence; they are failures of interpretation. The algorithm is doing precisely what it learned.</p><p>Once you understand this, your approach to leadership shifts. You stop assuming models &#8220;understand&#8221; and start asking the questions that matter: what data shaped this behaviour, where are the blind spots, what scenarios will break it, and where must humans remain in control? Your role is to define boundaries, validate behaviour, and anticipate failure modes.</p><p>Algorithms are powerful tools, but they are tools. They cannot question their assumptions, recognise nuance or self-correct their worldview. Only people can do that. Leaders who understand this avoid being blindsided by unexpected behaviour, vendor hype or inflated expectations. Instead, they create the conditions for algorithms to succeed safely and predictably.</p><p>Good AI leadership isn&#8217;t about writing models. It&#8217;s about understanding how they behave, when they fail, and how to guide the teams responsible for keeping them honest.</p><div><hr></div><h2>4. Python Literacy and Technical Fluency</h2><p>Another foundational module in my Master&#8217;s was Python programming. Not because the course was trying to turn us all into software engineers, but because Python is the language of modern AI. It is the workshop where almost every model is designed, tested and deployed. It is also the language behind data pipelines, feature engineering, model evaluation, and the majority of research papers and practical examples in the field.</p><p>Before starting the programme, I had always seen Python as just another scripting tool. And it&#8217;s worth pausing here because earlier in this article, I said you don&#8217;t need to become a data scientist or write machine learning models. That still stands. Understanding Python isn&#8217;t about becoming hands-on or replacing your engineers; it&#8217;s about gaining the fluency to lead them well. You don&#8217;t learn Python to write production systems. You know just enough to see how AI actually works under the surface, so your leadership decisions are grounded in reality rather than assumption.</p><p>Before starting the programme, I had always seen Python as just another scripting tool, a general-purpose language sitting somewhere between DevOps automation and data analysis. Within weeks, it became clear why the entire AI ecosystem has settled around it. Python is powerful, readable and forgiving. It lets you move quickly, experiment freely and translate ideas into working prototypes without wrestling with the language itself.</p><p>That mattered for my learning. Understanding Python didn&#8217;t just make me more comfortable with the technical modules; it made the underlying AI concepts click into place. When you write a few lines of code to clean a dataset, build a regression, or test a neural network, the concepts stop being abstract. They become concrete. You see how the maths translates into behaviour. You see how small changes in data shape model performance. You see where things break. That level of familiarity changes everything.</p><p>And this is where Python becomes essential for IT leaders. Not because you need to code, but because understanding the ecosystem gives you fluency in the world your AI teams are operating in. Data scientists and machine learning engineers live in Python every day. They use it to prepare and clean data, build models, test features, integrate with APIs, deploy pipelines and automate workflows. If you want to lead those teams effectively, it helps to understand the tools they use, the constraints they face and the effort involved in what they&#8217;re building.</p><p>Even basic familiarity creates strategic advantages. You gain a clearer sense of what is easy, what is difficult, and what is genuinely complex. You understand why specific requests require days rather than hours, and why data issues slow teams down long before modelling even begins. This isn&#8217;t about interrogating your engineers or micromanaging workflows. It&#8217;s simply about having enough context to engage confidently and make decisions grounded in reality.</p><p>You don&#8217;t need to write Python, debug Python or build models in Python. But developing a working understanding of why it is used, how it fits into the workflow and what it enables gives leaders a bridge into the technical reality of AI. It strengthens your credibility and sharpens decision-making without drifting into doing the team&#8217;s job for them.</p><p>Good AI leadership isn&#8217;t about becoming a programmer. It&#8217;s about developing enough technical fluency to understand the landscape and make decisions with confidence.</p><div><hr></div><h2>5. Model Performance Over Time</h2><p>One of the biggest surprises when I entered the world of AI wasn&#8217;t the complexity of the models, but how quickly they can drift. Earlier in my career, if a system worked on Monday, it would still work on Friday. With AI, the ground shifts beneath you.</p><p>When you deploy a model, you&#8217;re deploying a snapshot of the past, a frozen moment in the organisation&#8217;s behaviour, customer patterns or operational processes. But the world refuses to stay still. Trends change. Customer behaviour evolves. A process gets tweaked without anyone realising the impact. Within weeks, a previously accurate model can begin making flawed predictions and, unless someone is watching, those flaws scale silently.</p><p>Consider a manufacturing and distribution environment that begins using demand forecasting. Imagine a model trained on three years of stable ordering patterns across your warehouses. It performs well at launch, predicting stock levels, replenishment cycles and likely order volumes with impressive accuracy. Then a new product line is introduced, or a logistics partner changes schedules, or a raw material shortage forces different buying behaviour. Suddenly, the model is forecasting based on patterns that no longer exist. From the outside, the model appears unreliable. In reality, it is still doing exactly what it was trained to do; the world around it has changed.</p><p>I saw something similar firsthand in a recent internal project. A model built to route support tickets performed well at launch, but within a month, accuracy had noticeably declined. The reason? A team leader updated the category list without telling anyone. Humans adapted instantly. The model didn&#8217;t. It kept confidently routing tickets based on patterns that no longer existed.</p><p>This is where many organisations underestimate the ongoing work required to keep AI healthy. It&#8217;s not enough to train a model. You need:</p><ul><li><p>Monitoring that surfaces changes in behaviour.</p></li><li><p>Ownership that doesn&#8217;t disappear after deployment.</p></li><li><p>Retraining cycles tied to business rhythms.</p></li><li><p>Alerts for drift before it becomes a failure.</p></li></ul><p>Models don&#8217;t degrade because they break. They degrade because reality changes. Leadership is recognising that AI isn&#8217;t a &#8220;launch and forget&#8221; initiative. It&#8217;s a living system that needs the same care and attention as any critical service.</p><div><hr></div><h2>6. Organisational Readiness and Change</h2><p>Across my IT career, the most significant blockers to progress have rarely been technical. They&#8217;ve been cultural. And AI exposes that truth faster than anything else I&#8217;ve ever implemented. You can have a well-designed model, clean data and sensible architecture, but if the organisation isn&#8217;t ready to absorb AI into its workflows, you have a tough time ahead of you.</p><p>The first time I tried to introduce an  AI-supported workflow, the model wasn&#8217;t the issue. Trust was. People, in some cases, just rejected the technology; they were unsure what it meant for their jobs and became concerned about their judgment and accountability. I&#8217;ve seen this pattern repeat itself across service desks, warehouse operations, forecasting teams and commercial functions. When people don&#8217;t understand how the AI works or how its recommendations fit into their process, they default to caution or quiet resistance.</p><p>In a manufacturing and distribution environment, this becomes even more visible. Imagine an optimisation model that suggests a new picking sequence in a warehouse. The maths might be flawless, but if experienced operators don&#8217;t understand why the model recommends a change or if it conflicts with years of taking a different route, they will ignore it. Or imagine an order management system designed to automatically read customer purchase orders from emails and raise them inside your ERP. If the sales or admin teams don&#8217;t trust the model to extract quantities or product codes correctly, or if nobody knows who is responsible for correcting misreads, the automation becomes a source of anxiety rather than efficiency. The model might work most days flawlessly, but a single misinterpreted line item can undermine confidence across the whole team.</p><p>Organisational readiness isn&#8217;t about asking whether the technology is mature enough. It&#8217;s about asking whether the people, processes and culture around it are prepared. That means:</p><ul><li><p>People understand what the AI does and doesn&#8217;t do.</p></li><li><p>Teams know where human judgment is essential.</p></li><li><p>Ownership is defined and not left to &#8220;whoever picks it up&#8221;.</p></li><li><p>Existing processes are updated to provide AI recommendations a place to land.</p></li><li><p>Failure modes are discussed openly so people know what to expect.</p></li></ul><p>One of the most effective changes I made didn&#8217;t involve workshops or formal training sessions. It was much simpler. I involved the people who would be using the model right from the beginning. Instead of building something in isolation and unveiling it at the end, the teams helped shape how it worked while it was being developed. They reviewed early outputs, questioned assumptions, highlighted edge cases, and pointed out where the model didn&#8217;t reflect reality on the ground. Because they were part of the creation process, trust formed naturally. And once trust was formed, adoption wasn&#8217;t something we had to push; it happened on its own.</p><p>AI doesn&#8217;t remove human involvement. It reshapes it. Organisational readiness is about preparing people for that shift, so AI becomes a force multiplier rather than an unwelcome disruption.</p><div><hr></div><h2>7. Ethics, Governance and Accountability</h2><p>Governance is one of those topics that rarely gets the attention it deserves at the start of an AI initiative. When a model is new, and its outputs look impressive, it&#8217;s easy to get caught up in the possibilities and assume the risks are theoretical or far removed from day-to-day operations. But in practice, governance is often where AI either becomes a responsible, trusted capability or a painful lesson.</p><p>My first real exposure to the risks came during a Master&#8217;s assignment where we assessed a seemingly high-performing model. At first glance, the accuracy looked outstanding. But a deeper review revealed that it had learned patterns that disproportionately affected a specific group in the dataset. The numbers were impressive; the consequences would not have been. That experience reshaped my entire view of AI governance. It stopped being an academic concept and became a real responsibility.</p><p>Let&#8217;s consider a distribution environment, as previously discussed, the risks play out differently but with equal weight. Imagine an automated system scoring supplier performance. If the model quietly learns biases in historical data, perhaps favouring large suppliers simply because their volumes smooth out anomalies, procurement teams could make decisions that unfairly penalise smaller manufacturers. Or consider an AI model triaging inbound customer queries. If it consistently misclassifies issues from a specific region due to subtle linguistic patterns, customers in that region may receive slower or poorer service without anyone noticing.</p><p>These aren&#8217;t theoretical problems; they are real risks that emerge whenever AI is deployed at scale without proper oversight.</p><p>Good governance means digging beneath the surface:</p><ul><li><p>How was the model trained, and what data shaped its behaviour?</p></li><li><p>What assumptions does it rely on?</p></li><li><p>Where are the blind spots or edge cases?</p></li><li><p>How confident should we be in its decisions, and under what circumstances?</p></li><li><p>What does &#8220;good&#8221; look like, and who decides?</p></li></ul><p>Accountability must be unambiguous. Someone in the organisation must be able to say, <em>&#8220;I understand how this works, and I stand behind it.&#8221;</em> That responsibility cannot be outsourced to vendors, consultants or even technical teams. Governance is a leadership discipline.</p><p>And governance isn&#8217;t about slowing progress or creating bureaucracy. Done well, it builds trust with customers, regulators, and the teams who rely on AI to do their jobs. Clear governance frameworks encourage adoption, reduce fear and provide the confidence needed to scale AI responsibly.</p><p>When leaders treat governance as part of their strategic remit rather than a procedural hurdle, AI becomes not just influential but trustworthy.</p><div><hr></div><h2>8. Cost, Compute and Scaling Decisions</h2><p>One of the easiest mistakes to make with AI is assuming the cost sits in the model itself. You build a prototype, it sprints on a laptop, and you think, &#8220;Great, this won&#8217;t be expensive.&#8221; Then you try to scale it, and that is when reality arrives.</p><p>I often take the opportunity to explore the difference between training a model on my laptop and running one in production. The gap is usually quite extraordinary. A simple classification model performed well on small datasets, but when we fed it enterprise-scale data, the compute requirements jumped dramatically. Storage, networking, GPU cycles, inference time, and pipeline orchestration all became real constraints. It was the first time I fully appreciated that AI isn&#8217;t just software. It is infrastructure.</p><p>I&#8217;ve seen the same pattern play out in industry. A team builds a proof of concept in a controlled environment, it performs well, and everyone feels confident. Then the project hits production, cloud spend spikes, and inference takes longer than expected, and the team suddenly realises they&#8217;ve designed something robust but not sustainable.</p><p>In any organisation operating at scale, these challenges become even more pronounced. Models that support critical operations, whether they are forecasting demand, prioritising workloads, analysing customer behaviour or optimising internal processes, often require:</p><ul><li><p>Frequent retraining as new data arrives.</p></li><li><p>Large volumes of historical data stored and accessible at speed.</p></li><li><p>Real-time or near-real-time inference depending on the use case.</p></li><li><p>Robust pipelines that can cope with large data movements and operational spikes.</p></li></ul><p>This is where technical literacy really matters for IT leaders. Not because you need to architect the system yourself, but because you have to judge whether the proposed approach is appropriate. A technically sound model may still be the wrong choice operationally.</p><p>I remember evaluating an optimisation solution that promised exceptional accuracy. The model was impressive, but the computational cost of running it at the frequency the business required would have wiped out any benefit it generated. When we stepped back, a simpler and far cheaper model delivered the same business outcome. The value wasn&#8217;t in the model&#8217;s power; it was in choosing the right tool for the job.</p><p>Good AI leadership is not about choosing the most advanced architecture. It is about balancing accuracy, cost, speed and practicality. Leaders who understand these trade-offs avoid spiralling cloud bills, frustrated engineering teams and AI solutions that collapse under operational pressure.</p><div><hr></div><p>AI is changing the shape and expectations of IT leadership, but it isn&#8217;t doing it by replacing the skills we already have. It&#8217;s doing it by stretching them. The days when you could lead purely through experience, instinct or broad technical understanding are fading. Today, credibility comes from fluency, from seeing how the moving parts connect, and from understanding enough of the mechanics to lead with clarity rather than caution.</p><p>What this journey shows is that none of these concepts, data, algorithms, Python, performance, people, governance, or cost exist in isolation. They form a connected foundation, a new kind of technical literacy that gives leaders the confidence to engage rather than delegate, to question rather than accept, and to shape AI outcomes rather than be shaped by them.</p><p>The good news is that you don&#8217;t need to become an expert in any of it. You don&#8217;t need to write code, train models or architect pipelines. You need to understand the terrain well enough to navigate it. Enough to make informed decisions. Enough to challenge assumptions. Enough to give direction instead of taking it.</p><p>AI will become a defining part of how organisations operate. The leaders who thrive will be the ones who choose to step toward it, not away from it. Those who build literacy early will become the steadying hand their teams look to when the noise grows louder.</p><p>You already have the foundation. The experience. The leadership instincts. This is simply the next step, the one that makes you credible in an era shaped not by systems alone, but by intelligence.</p><p>With every step you take toward AI literacy, you widen your influence and strengthen your leadership. The future is already shifting in your favour.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.ricchapman.ai/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Get practical AI leadership insights straight to your inbox.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Human-Centred Intelligence: Leading IT in the Age of AI]]></title><description><![CDATA[A practical guide for IT leaders navigating the next era of intelligence.]]></description><link>https://newsletter.ricchapman.ai/p/human-centred-intelligence-leading</link><guid isPermaLink="false">https://newsletter.ricchapman.ai/p/human-centred-intelligence-leading</guid><dc:creator><![CDATA[Ric Chapman]]></dc:creator><pubDate>Thu, 04 Dec 2025 08:39:48 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/eb9fb9e0-a24e-470e-8919-16adab66389b_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>The pressure to &#8220;deliver AI&#8221; has become the new corporate mantra, but what does it really mean?</p><p>I&#8217;ve practically lost count of the times I&#8217;ve sat in front of peers, industry leaders, interviewers, merger and acquisition teams, private equity, and a whole host of business leaders, managers and CEOs who have all asked me for the same thing.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.ricchapman.ai/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><blockquote><p><em><strong>&#8220;We want you to deliver AI.&#8221;</strong></em></p></blockquote><p>I&#8217;m positive that IT leaders across the globe are consistently hearing the same request, and many of us are working hard to suppress a blank stare while desperately piecing together the right words to sound visionary, strategic, and in control. Interviewers expect something plausible and innovative. Executives want a clear roadmap. The business demands tangible value. And yet, that&#8217;s often difficult to produce for three main reasons:</p><ol><li><p><strong>Business leaders</strong> often ask for &#8220;AI&#8221; without a clear definition of what outcome they expect.</p></li><li><p><strong>IT leaders</strong> are still defining what &#8220;delivering AI&#8221; looks like in practice.</p></li><li><p><strong>Strategic alignment</strong> is unclear; many teams struggle to turn ambition into a practical, value&#8209;driven plan.</p></li></ol><p>Sometimes, it&#8217;s a blend of all three, resulting in awkward conversations and the occasional tactical side-step to avoid eager CEOs while managing the very real frustrations of modern tech leadership. I&#8217;ve seen talented IT leaders get it completely, hopelessly wrong, not out of incompetence (occasionally out of incompetence), but out of the pressure to sound certain, and be certain, in an uncertain space.</p><p>So where does that leave today&#8217;s IT leader in the age of AI? When everyone around you is looking for you to understand, looking to you for all the answers, how do we move forward confidently as IT leaders?  How do we effectively leverage the AI landscape and deliver on its promises?  Creating the workplace of the future is not all as clear as we&#8217;d like it to be.</p><p>In this article I want to cover some of these concepts, this will help set some of the foundations for future writings, but will also clarify some of our immediate challenges as IT tech leaders.  Today we&#8217;ll cover:</p><ol><li><p><strong>The IT Leader&#8217;s New Frontier</strong>, an introduction to how AI is reshaping the identity and expectations of IT leadership.</p></li><li><p><strong>The Shift From Ownership to Orchestration</strong>, a look at why modern IT leaders must guide ecosystems rather than own every system.</p></li><li><p><strong>The New Skillset of the IT Leader</strong>, a breakdown of the evolving capabilities needed to lead confidently in the AI era.</p></li><li><p><strong>Building the Foundations Before the Tools</strong>, a reminder that without solid data, process, and governance foundations, AI will fail before it begins.</p></li><li><p><strong>The Danger of AI Theatre</strong>, an honest look at superficial AI initiatives that create noise instead of value.</p></li><li><p><strong>AI as Cultural Transformation</strong>, an exploration of how mindset, trust, and behaviour determine AI success more than tooling.</p></li><li><p><strong>The Critical Role of Problem Definition</strong>, a dive into why defining the right problem matters more than choosing the right model.</p></li><li><p><strong>Aligning AI with Real Business Value</strong>, a look at tying AI initiatives to meaningful, measurable outcomes.</p></li><li><p><strong>Moving from Firefighting to Foresight</strong>, exploring how AI elevates IT from reactive support to proactive strategic leadership.</p></li><li><p><strong>Why &#8220;I Don&#8217;t Know&#8221; is a Leadership Superpower</strong>, a reflection on how honesty and curiosity build stronger, more credible leadership.</p></li></ol><div><hr></div><p><strong>1. The IT Leader&#8217;s New Frontier</strong></p><p>AI is transforming IT from a business support function into a proactive engine of business productivity and intelligence. But the tools alone don&#8217;t define success; the people who use them do. The new IT frontier is about orchestrating humans and machines toward shared goals. It&#8217;s about empathy in automation and foresight in data. It is not about purchasing an AI licence and hoping it magically transforms the organisation. It&#8217;s not about panic&#8209;buying every tool with an AI sticker on the box. It&#8217;s not swapping out mature, reliable systems for overpriced &#8220;AI&#8209;powered&#8221; equivalents that introduce more complexity than value. Simply put, tool shopping is not a strategy. Buying licences is not a transformation. Real AI adoption requires clarity, capability building, problem definition and a deliberate plan that connects technology to meaningful outcomes. A simple fact that is incredibly lost on most, myself included, when the AI revolution started building momentum.</p><p>We&#8217;ll cover some of this in greater depth, but in short, the role of the IT leader will change rapidly over the next few years, perhaps even the next months, what with this rapid rate of change.  It&#8217;s fascinating to be part of the next technical revolution, and current and future IT leaders will be the ones leading the charge and guiding others and businesses to help them succeed.</p><div><hr></div><p><strong>2. The Shift From Ownership to Orchestration</strong></p><p>Critical to this success will be the shift from ownership to orchestration, foundational in fact.  The cloud has quietly rewritten the rules of IT, and AI has made that shift impossible to ignore. Most modern AI capability lives in the cloud, built on infrastructure, models, and compute power that no individual organisation could realistically own. This means IT leaders now operate in an environment where the majority of the technology stack sits outside their walls.</p><p>Instead of owning systems end&#8209;to&#8209;end, IT now orchestrates an ecosystem of cloud services, vendors, APIs, automations, and data flows. The role has evolved from builder to conductor, from controlling every component to designing how the components work together.</p><p>This shift is driven by reality:</p><ul><li><p>Vendors now innovate faster than internal teams can track.</p></li><li><p>Data flows across dozens of platforms, not a single controlled environment.</p></li><li><p>Business teams adopt tools independently, forcing IT to guide rather than gatekeep.</p></li><li><p>AI services are consumed rather than installed.</p></li></ul><p>Ownership required certainty. Orchestration requires curiosity, clarity, influence, and systems thinking.  The shift has been happening for a while, but those of us still holding onto infrastructure ownership will need to learn to start letting go.  It&#8217;s no longer about controlling and holding everything tightly but about ensuring we can manage hybrid environments, ensure everything works together and then ultimately prepare for a shift to a fully cloud-managed environment.  </p><div><hr></div><p><strong>3. The New Skillset of the IT Leader</strong></p><p>The modern IT leader&#8217;s skillset is shifting from technical mastery to strategic intelligence, the ability to understand how technology, data, people, and business goals intersect.  You could argue and say this is what a lot of IT leaders do, particularly those holding a CTO badge, but all IT leaders are feeling a shift as this responsibility starts to move further down the middle management chain.  So, because of this shift, take note of the following:</p><p><strong>Be adaptive and comfortable with change</strong> <br>An ability to embrace change and remain adaptive will be essential in the current and future AI workplace. This ties closely to the rapid pace of technological evolution. Adaptability keeps you relevant. AI itself is the new skill of the decade, not just its tools, but the underlying technologies that power it, particularly data science, automation, and modern programming practices.  Comfort and understanding with these technologies will be critical.</p><p><strong>Translating business needs into data opportunities</strong> <br>The most valuable leaders can articulate how data supports decisions, improves outcomes, and unlocks opportunities. They bring clarity where the business brings complexity, and help teams understand how AI can transform that clarity into capability. </p><p><strong>Ethical awareness and human&#8209;centred leadership</strong> <br>AI also introduces new risks, biases, and uncertainties, which have inevitably freaked many people out.  Outlandish claims of AI stealing jobs and taking over the world by key public figures have left many feeling uneasy.  This leaves it to us to set the tone by ensuring technology is deployed responsibly, transparently, and in service of people, not at their expense. A clear ethical framework will serve all leaders of course but the specifics of ethical AI carry a significant amount of weight at the moment.  People are looking for clear, moral guidance.  Human-centred AI is an important ethical perspective.</p><div><hr></div><p><strong>4. Building the Foundations Before the Tools</strong></p><p>Some of my predecessors went straight to the tools in eager adoption of AI, but there is so much to consider operationally, so much so that without the groundwork covered, even those tools will be shaky at best.  This creates immediate doubt culturally and professionally, so it&#8217;s best to get our AI ducks lined up before we start diving in.</p><p><strong>Data quality and accessibility</strong>  <br>AI for all the intelligence it delivers (or seems to deliver) is a result of having the right data. AI cannot compensate for missing, incorrect, or inconsistent data, and most businesses have a data landscape to be feared, at the very least, looked at sceptically. IT leaders must understand where their data lives, how clean it is, and how easily it can be accessed. Without this, every AI initiative becomes guesswork dressed up as progress.</p><p><strong>Process clarity and standardisation</strong>  <br>I&#8217;ve had the pleasure of working in a number of different industries, businesses of varying sizes and capabilities but this is always an area of struggle or at least refinement. In most cases, processes are undocumented, inconsistent, or vary wildly across teams and because of this, AI has nothing stable to latch onto. Clear processes create predictable patterns, which help the AI adapt and learn quickly. Not only that but clear process documentation will assist with the issues around problem definition which I describe later.</p><p><strong>Integration and interoperability</strong>  <br>Sadly, businesses are often a patchwork of legacy systems, modern apps, spreadsheets, and shadow IT. AI thrives in connected environments, and rarely do we have the ability to ensure systems can talk to each other, a prerequisite to business intelligence and AI.  It&#8217;s often we find that any AI strategy worth the computer it&#8217;s typed on will require plans to out some if not all of these legacy platforms.  Aging ERP, HR, and ropey telephony platforms are often some of the first targets.</p><p><strong>Governance and security</strong>  <br>An important consideration, without any doubt and often deployed by sales companies to drive fear into AI adopters.  How often I&#8217;ve heard the story of a University inadvertently sharing payroll data to public LLM (Large Language Model) is unreal but it paints a clear warning. AI introduces new data flows, permissions, and compliance considerations. Without governance, leaders risk deploying solutions that expose data, breach regulations, and ultimately undermine the trust of AI. Do your homework, get this right, get an outside consultant if needed to plug this potential governance and security gap.  Better safe than sorry.</p><p><strong>Capability building and workforce readiness</strong>  <br>Tools will not save a team that isn&#8217;t prepared to use them. Training, experimentation time, and skill&#8209;building are essential. As IT leaders, we&#8217;re the voice to give people confidence, but ensuring that we&#8217;re fully prepared prior is critically the most important thing. If we&#8217;re not confident and clear in what we&#8217;re trying to deliver, our teams nor the business will follow suit. Get comfortable and clear on your strategy before you start shouting it from the office roof.</p><p><strong>Why this matters</strong>  <br>Most organisations want to jump straight to tools because tools <em>feel</em> like progress. But without these foundations, AI becomes slow, unpredictable, inaccurate, or politically unworkable. The smartest leaders know that the work no one sees is the work that makes everything else possible.</p><div><hr></div><p><strong>5. The Danger of AI Theatre</strong></p><p>I may have accidentally raised the matter of incompetence earlier and this is what I was specifically referring to, AI Theatre. It&#8217;s the performance of progress without the substance of progress. It&#8217;s the organisational habit of running flashy pilots, producing polished slide decks, or name&#8209;dropping AI models without ever delivering meaningful value. </p><p>A real example of this was the delivery of Microsoft Teams Transcription, long before the days of meeting summaries, auto-built task lists and emailing following up actions.  Just a transcript.  This AI breakthrough was touted as the next business breakthrough, every manager and business leader got pulled into meetings, was shown a flashy slide deck and then it was demonstrated.</p><p>Anyone familiar with early or even todays raw transcriptions will know how painful they are to read and decipher, on their own they deliver very little but the theatre in which it was presented built it up to be so much more, only to then watch the reputation of AI and the individuals involved come crashing down. This undoubtedly stalled AI adoption at the business.</p><p>They were trying to solve a problem that didn&#8217;t exist. It momentarily created the illusion of innovation while masking the absence of any meaningful strategy. The danger wasn&#8217;t just wasted money and time; it&#8217;s the erosion of trust in AI itself. When executives see pilots go nowhere, they start to believe the technology has no real impact, when in reality, it was never given the structure or sponsorship it needed. The IT leader&#8217;s role is to recognise when AI is being performed rather than implemented, and redirect effort toward problems that matter.</p><div><hr></div><p><strong>6. AI as Cultural Transformation</strong></p><p>Tech adoption and particularly AI adoption, fail far more often because of people than because of technology. The tools are ready. The real question is whether the organisation is.</p><p>True AI transformation requires a shift in mindset: curiosity over caution, experimentation over perfection, and learning over defensiveness. Teams need psychological safety to try new approaches without fear of embarrassment, and all leaders (not just IT leadership) must create the conditions for that safety. Without it, AI becomes something people avoid rather than embrace.</p><p>Many organisations rush to deploy tooling because it feels like visible progress. But deploying a tool without preparing the culture almost guarantees resistance. People don&#8217;t reject AI because it&#8217;s complicated; they reject it because it threatens routines, comfort, identity, or control. Cultural readiness is what bridges that gap.</p><p>Business culture also doesn&#8217;t move at the speed of code or cloud innovation. It moves slowly, through trust, clarity, communication, and shared understanding. That&#8217;s why tech leaders must act as cultural translators, helping teams understand not just <em>how</em> AI works, but <em>why</em> it matters and <em>what it enables</em>.</p><p>Cultural transformation requires cross-functional partnership. HR, operations, finance, IT, and executive leadership all shape how people experience change. If even one of those functions drags its feet, adoption slows to a crawl.</p><p>The IT leader&#8217;s job isn&#8217;t to force AI onto the organisation. It&#8217;s to guide people through the uncertainty, build alignment, and create a culture where intelligence, human and machine, can thrive.</p><div><hr></div><p><strong>7. The Critical Role of Problem Definition</strong></p><p>Problem definition is where most AI ambitions either take shape or fall apart, and in my experience, this is the bit everyone rushes past because it isn&#8217;t shiny, it isn&#8217;t fast, and it doesn&#8217;t feel like &#8220;AI adoption&#8221;. But this is exactly where the real work begins.</p><p>A clear problem definition is the single greatest predictor of whether an AI initiative will succeed. Most organisations begin with a solution in mind, &#8220;We need AI for forecasting&#8221;, &#8220;We need AI for stock control&#8221;, &#8220;We need AI to improve customer experience&#8221;, when in reality, these are outcomes, not problems.</p><p>When someone says &#8220;We need AI for forecasting&#8221;, what they really mean is &#8220;We don&#8217;t fully understand why our forecasting isn&#8217;t working&#8221;. When someone says &#8220;We need AI for stock control&#8221;, the real issue is &#8220;We don&#8217;t know where the friction is, who owns the data, or why the process keeps breaking&#8221;. That&#8217;s the level we need to get to.</p><p>The job of an IT leader isn&#8217;t to force AI into a business problem; it&#8217;s to keep asking why the problem exists in the first place. Sometimes AI is the answer. Sometimes it isn&#8217;t. And sometimes the hardest part is admitting that a broken process or a lack of data maturity is the real culprit, not the absence of a model.</p><p>This is also where honesty matters. Buying CoPilot or rolling out ChatGPT isn&#8217;t going to magically turn a business into an AI&#8209;driven organisation. These tools can support intelligence, but they cannot create it from thin air. If we don&#8217;t understand the problem deeply, AI becomes a guessing game, and guessing is expensive.</p><p>Strong problem definition keeps us disciplined. It keeps us honest. And it ensures that when we <em>do</em> bring AI into the equation, it&#8217;s solving something real, measurable, and worth solving.</p><div><hr></div><p><strong>8. Aligning AI With Real Business Value</strong></p><p>If there&#8217;s one thing AI has done brilliantly, it&#8217;s convince every business that &#8220;value&#8221; automatically appears the moment you plug in a model. We know better. AI only creates value when the problems are clear, the processes are stable, the people are ready, and the outcomes are measurable. Everything else is noise.</p><p>Aligning AI with real business value starts with a blunt question: <em>What are we actually trying to improve?</em> Not theoretically, not aspirationally, but in the day&#8209;to&#8209;day reality of the business.</p><p>Sometimes the answer is efficiency. Sometimes it&#8217;s accuracy. Sometimes it&#8217;s saving people from spending their lives in spreadsheets. Sometimes it&#8217;s unlocking insights that the business never had access to. Whatever the case, the value must be specific, visible, and understood.</p><p>One thing I&#8217;ve learned the hard way is that value isn&#8217;t created at the moment of adoption; it&#8217;s created at the moment of <strong>integration</strong>. When AI is woven tightly into the workflow, when it changes how decisions are made, when it nudges behaviour in better directions, that&#8217;s where the magic happens.</p><p>The challenge is that many organisations tie AI to value <em>after</em> the work is done, retrofitting benefits that don&#8217;t truly exist. As leaders, we have to resist that temptation. We define the value <strong>before</strong> the project starts, we track it as the work unfolds, and we validate it once deployed. That discipline stops AI from becoming theatre and keeps it anchored to outcomes that matter.</p><p>Most importantly, aligning AI with value isn&#8217;t about ROI spreadsheets or consultancy frameworks, it&#8217;s about asking whether the people using it feel supported, empowered, faster, clearer, or more capable than they did before. Real value is felt long before it&#8217;s measured.</p><p>When we get this right, AI stops being a science project and becomes what it should have been all along: a meaningful contributor to how the business thrives.</p><div><hr></div><p><strong>9. Moving From Firefighting to Foresight</strong></p><p>If there&#8217;s one experience every IT leader shares, it&#8217;s living in constant firefighting mode. Tickets flying in, systems wobbling, users frustrated, and every day feeling like a sprint through an obstacle course. For years, this has been the default setting of IT, reactive, overloaded, heroic, and exhausted.</p><p>AI finally gives us a way out of that cycle.</p><p>The real promise of AI in IT isn&#8217;t automation for automation&#8217;s sake; it&#8217;s the shift from <em>responding</em> to <em>anticipating</em>. From waiting for something to break to knowing it&#8217;s going to break long before anyone else does. From juggling escalations to preventing them quietly in the background.</p><p>This is what foresight looks like:</p><ul><li><p>spotting patterns in performance data long before thresholds are crossed</p></li><li><p>predicting user needs before they become pain points</p></li><li><p>identifying bottlenecks in workflows before they slow the business down</p></li><li><p>uncovering improvements that no human had the time or visibility to notice</p></li></ul><p>And here&#8217;s the subtle but important part: foresight changes how IT is <em>perceived</em>. When you move from break&#8211;fix firefighting to strategic insight, you stop being the department that &#8220;fixes things&#8221; and start being the function that <strong>guides the future of the business</strong>.</p><p>AI won&#8217;t eliminate every fire, but it will shrink the forest. It gives leaders the fuel to move away from operational chaos and toward intentional, proactive strategy, the kind of strategy that not only improves uptime but also elevates IT into the realm of genuine business leadership.</p><p>Foresight is another area where the value of AI becomes visible, tangible, and deeply respected. It&#8217;s where IT stops reacting to the business and starts shaping it.</p><div><hr></div><p><strong>10. Why &#8220;I Don&#8217;t Know&#8221; Is a Leadership Superpower</strong></p><p>There&#8217;s a strange pressure in tech leadership, this idea that the moment a new wave of innovation arrives, we&#8217;re supposed to become instant experts, fluent in every model, every acronym, every opportunity it presents. It&#8217;s nonsense, of course, but it&#8217;s amazing how quickly that pressure convinces smart people to bluff.</p><p>The truth is simple: the leaders who try to look certain are the ones who make the most damaging mistakes.</p><p>Saying &#8220;I don&#8217;t know&#8221; isn&#8217;t an admission of incompetence. It&#8217;s a statement of responsibility. It tells the room that you value accuracy over ego, progress over performance, truth over theatre. And in a landscape as fast-moving as AI, honesty is one of the most stabilising forces a team can have.</p><p>When you say &#8220;I don&#8217;t know yet, but I will&#8221;, you&#8217;re doing three powerful things:</p><ul><li><p>setting a realistic pace for the business</p></li><li><p>creating space for learning and experimentation</p></li><li><p>anchoring the organisation in evidence, not assumptions</p></li></ul><p>People trust leaders who tell them the truth, especially when the truth is uncomfortable. Pretending to know everything in AI isn&#8217;t leadership; it&#8217;s gambling with the credibility of the entire tech function.</p><p>Real leadership is steady, grounded, and unafraid to acknowledge uncertainty. And ironically, the leaders most willing to say &#8220;I don&#8217;t know&#8221; are often the ones who end up knowing more than anyone else.</p><div><hr></div><p></p><p>If you&#8217;ve made it this far, you&#8217;ll know that AI isn&#8217;t a magic switch, and it certainly isn&#8217;t a shortcut. It&#8217;s the next evolution of how we lead, how we think, and how we build organisations that are genuinely ready for the future. Not because we bought the right tool, but because we built the right foundations, asked the right questions, and led with honesty rather than bravado.</p><p>The role of the IT leader is shifting faster than any time in recent memory. We&#8217;re no longer the people who simply keep the lights on. We&#8217;re the translators, the orchestrators, the cultural shapers, the problem definers, and the steady hands guiding businesses through a landscape that changes by the week.</p><p>This isn&#8217;t easy work, but it is meaningful work. And if we approach AI with clarity, integrity, and a human&#8209;centred mindset, we don&#8217;t just adopt new technologies, we elevate the entire organisation.</p><p>So take this as your reminder: you don&#8217;t need all the answers, you don&#8217;t need perfection, and you certainly don&#8217;t need to pretend. What you need is curiosity, courage, and the willingness to lead from a place of truth. The rest will follow.</p><p>This journey is only just beginning for all of us. And if we do it right, it&#8217;s a journey that will redefine what intelligent leadership looks like for the next decade and beyond.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.ricchapman.ai/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item></channel></rss>