Back/Personal/ChatGPT
IntermediatePersonalChatGPT

Build a Custom AI Tool to Describe Images in Slack

Create a personal Chrome extension that uses an AI vision model and a keyboard shortcut to generate detailed descriptions of images posted in Slack, improving accessibility and efficiency.

From How I AI

How I AI: Building Custom AI Accessibility Tools for Slack with Joe McCormick & Claude Code

with Claire Vo

Build a Custom AI Tool to Describe Images in Slack

Tools Used

ChatGPT

OpenAI conversational AI

02Step-by-Step Guide
1

Set Up the Extension and Shortcut

Begin by creating a new Chrome extension. In the manifest file, define a custom command that listens for a specific keyboard shortcut, such as Ctrl+Shift+D, and scope its activation to the Slack web app.

2

Capture the Image

Write a content script that, when the shortcut is triggered, identifies the image element currently in focus within the Slack message thread and extracts its source URL or data.

3

Send to AI for Analysis

Send the captured image data to an AI model with vision capabilities, like the ChatGPT API. The request should ask the model to provide a detailed description of the image's contents.

4

Display the Description

Once the AI returns the text description, display it in a user-friendly, accessible modal window that appears over the Slack interface, so you can read it without losing context.

5

Enable Follow-up Questions

Enhance the tool by adding a text input field to the modal. This allows you to ask follow-up questions about the image, sending them back to the AI to get more specific details.

Prompt:
what age child is this for?
Pro Tip: This interactive feature transforms the tool from a simple descriptor into a contextual Q&A bot for images.

Start shipping
better products.

Join 100,000+ product managers who use ChatPRD to write better docs, align teams faster, and build products users love.

Free to start
No credit card
SOC 2 certified
Enterprise ready