Exploring the context of online images with Backstory

New experimental AI tool helps people explore the context and origin of images seen online.

The ways people are using and interacting with images online is constantly evolving. Last year, we published a paper on determining trustworthiness through context and provenance, showing how better assessment tools can empower people to make informed decisions about what they’re seeing on the internet.

As part of our efforts to help people make informed choices, we’re developing easy-to-use provenance tools and in-product context features, and investing in areas like information literacy.

Today, we’re introducing Backstory, an experimental artificial intelligence (AI) tool that surfaces information and helps people learn more about the context of images seen online.

When given an image and a written prompt, Backstory investigates whether an image was AI-generated, when and where it’s previously been used online, and whether it’s been digitally altered. It quickly equips users with helpful information, responds to further prompts, describes whether and how an image has been used, and how its story may have changed over time. Backstory also generates easy-to-read reports of its findings.

Assessing trustworthiness through context and origin

Built using Gemini, Backstory draws on a number of detection technologies designed to identify whether an image is real or created using generative AI. Backstory then combines this with a more holistic assessment of the context of the image. It surfaces how the image has been used on the internet and other information like metadata to help answer the user's written prompt.

In most cases, determining whether an image is AI-generated is not the same as understanding if it’s trustworthy. For example, an image may not be AI-generated, but could have been altered or presented out of context — resulting in new, sometimes misleading, information.

Alternatively, an image generated using AI may support an authentic, creative or factual story. Accurately assessing the trustworthiness of an image often requires more knowledge of how the image was created, and a deeper understanding of the context surrounding it.

Taking a holistic approach

It’s crucial that industry, civil society, governments, academics and users work together to develop and refine the tools and programs necessary for maintaining the integrity of our information ecosystem.

As we continue to conduct research and develop Backstory, we’re working closely with trusted testers, including content creators and expert information practitioners, who manage, organize and disseminate high quality information.

Throughout the year, we’ll gather feedback about examples, user experiences and more to improve our technology and make it more helpful.