DATADISCOVERY OVERVIEW


DataDiscovery finds every file across your data estate, shows what it is worth and what it costs, and acts on it by policy, from cleanup to AI pipelines. Your data stays where it is.

1.4B

files indexed in 2 hours on 3 nodes

500K–600K

files per second when reindexing

103B+

files cataloged at one customer, across 4 data centers

260 PB

of media indexed at one customer, across 6 locations

The tour

Follow one catalog from the first scan to the first action. Each step uses the storage you already own. Data users work from a web browser, with nothing to install on their computer.

01 Connect

Enter each file server or S3 endpoint once, with its credentials. DataDiscovery finds its shares, exports, and buckets, and you choose which volumes to scan.

A guided setup takes an administrator from license to first scan, and new storage from any vendor plugs into the same catalog.

Works with storage such as

  • NFS exports
  • SMB shares
  • Amazon S3
  • S3-compatible object storage
  • Local file systems
  • Connectors for cloud and archive systems

02 Index

Indexers work in parallel across many systems at once, and you add nodes as your estate grows.

  • Scale-out indexers that scan many systems at the same time.
  • A built-in cache that keeps rescans fast.
  • Every file records the storage and volume it came from.
  • Use Live View to browse the storage as it is right now, when you need to see recent changes between scans.

Scale-out indexing

Indexer 1
Indexer 2
Indexer 3
Add a node

1.4B files indexed in 2 hours on 3 nodes

03 Enrich

Every file starts with its standard metadata, such as path, owner, size, and dates. Built-in plugins add more at index or post-index time, such as media details, project information, and filesystem properties.

With the Content Match plugin, DataDiscovery can look inside a file’s header to find a value written there, such as a project or job code, and add it to the catalog. Tags and rules add the rest, so every file can be found with the words your business uses.

05 Analyze

Several analytics help you discover, measure, and organize your data, such as who owns it, how old it is, what it costs, where it grows, and which files nobody uses anymore.

Dashboards and reports turn the catalog into answers for IT, finance, and data owners. The Insights dashboard goes one step further and ranks the next best actions after every scan.

06 Act

Run file actions straight from search results, or set rules that tag, move, archive, or clean up data on a schedule.

To move data, DataDelivery is the recommended mover, and DataDiscovery also works with tools such as Rclone and Dell SmartSync.

07 Deliver

Curate file lists by any metadata, export them, and send them where your teams work, such as Snowflake or a lakehouse.

APIs connect the catalog to your own tools and workflows.

From the catalog to your stack

  • Export file lists
  • Snowflake
  • Lakehouses
  • BI tools
  • REST API
  • AI pipelines

08 Ask

With the AI Connector, an option on any plan, ask questions such as “Which projects have not been touched in a year?” and get answers from your catalog, on desktop or mobile, powered by the LLM of your choice.

Every action it proposes waits for a person to approve it.

Scale and performance

Built for scalability.

Scale out

Add nodes, not projects.

Indexers scale out as your file count grows. Each deployment is sized by file count, not terabytes.

Fast rescans

Read only what changed.

A built-in cache keeps rescans fast, so reindexing runs at 500K to 600K files per second.

Guided setup

From license to first scan.

A guided setup walks an administrator through each step, with a live health bar for the whole system.

Open foundation

No lock-in.

Built on open-source technologies proven at enterprise scale, with open APIs.

Security and control

Professional

Index, enrich, and analyze: find and understand every file, with business context and actions you trigger.

Enterprise

Everything in Professional, plus orchestration: rules that automate the data lifecycle.

Multistream

Everything in Enterprise, plus organized datasets for AI, BI, data lakes, and lakehouses.

Go deeper

Features

Every capability, from scanners to reports.

Architecture

How the catalog is built and how it scales.

Plugins

Enrichment, automation, and file actions.

DataDelivery

Move and deliver data by policy.

Scroll to Top