# Visualizing Data Lineage

If you have a large number of data objects, it can be difficult to keep track of where all your data is coming from, how it’s being queried, and where it’s ending up. DeltaStream addresses this via Stream 360.

Stream 360 displays the movement of your data as a flowchart, from source to destination, including how it’s transformed along the way. You can see at a glance all your DeltaStream objects – streams, changelogs, tables, materialized views – and their relationships with queries. This gives you a clear visual representation of data lineage throughout your DeltaStream ecosystem. You can:

* understand your processes
* validate data at particular points in the data lineage
* see all aspects of the pipeline you’re building – joins, sources, pipeline results (such as writings to a materialized view), and more
* examine streams and materialized views and quickly ascertain what data you may wish to add or whether the data you need is in the data stores displayed.
* move or group objects to isolate and examine a specific process

The end-to-end view also helps you avoid negative or unanticipated downstream impacts resulting from any changes you make.

You can also use Stream 360 to view metrics about DeltaStream objects and queries:

* Click on a particular DeltaStream object, and a side panel displays that enables you to print records in the object and view the object’s columns and metadata.
* Click on a particular query, and a side panel displays with some basic metrics and metadata about the query. You can also terminate queries from this panel.

### Using Stream 360

From any screen in DeltaStream, click the **Org Name** arrow and select the organization you wish to display.

In the lefthand navigation, click the Stream 360 icon ( ![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXdvHVTuFqRFIvJhEywuwqYt1Qoq4pwgg4ZEpKGsjM5F5XjidwYGQ0pjqR6mJkoICXXfrGq9UX7jU-0jcfAPyasp5iUCBJxal_pXtfE5-2wSKsynCBTqeB1W6paCfAv-yL5TEm9MKA?key=I5KlA42aPCnDTSburBrQ34jD) ) to display the flowchart.

<figure><img src="https://1288764042-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fdbd9e6ZJodkgF1H6AVay%2Fuploads%2Fgit-blob-defaef7ad0a3da436061209f704b5fc39e3eb51a%2F360%20Main.png?alt=media" alt="" width="563"><figcaption></figcaption></figure>

To see the location of the displayed objects, in the top right corner check **View location**. Paths display immediately above each object.

<figure><img src="https://1288764042-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fdbd9e6ZJodkgF1H6AVay%2Fuploads%2Fgit-blob-b5d2a066725ab7f9f3d849d548d628e5bdd7f05e%2FBasicFlowchartWLocation.png?alt=media" alt="" width="563"><figcaption></figcaption></figure>

To see whether multiple objects share a topic, in the top right corner check **View Topic Link**. If a process involves multiple topics, checking this box highlights those topics, regardless of where they may display on the canvas, and shows how they are connected. This makes it easier yet to envision more complex workflows.

<figure><img src="https://1288764042-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fdbd9e6ZJodkgF1H6AVay%2Fuploads%2Fgit-blob-fb0991bc11b5bacae5fc620f46c7fa52e61c83db%2FView%20topic%20link%20checked%20highlighted%20revised%20(1).png?alt=media" alt="" width="563"><figcaption></figcaption></figure>

### Viewing DeltaStream Object Details

You can quickly drill down on any particular DeltaStream object in the flow to see details of that object.

To start, click the **TOC panel** (![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXfURpTS5W7anawQ3edy0IDu0OfVIz-_TdO-p5TDQHj8cDz6qrbg6irrxoCwpcQ5SxrYiW1pxHfDScoJzPKpFJzMEIn1UsNzrMCWExR9SigoT7PlA1q8ENGitZADCGVsW3AW8NPaHQ?key=I5KlA42aPCnDTSburBrQ34jD)) to display your organizational hierarchy. Then click the item you want.

<figure><img src="https://1288764042-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fdbd9e6ZJodkgF1H6AVay%2Fuploads%2Fgit-blob-6a3c0b1b370b2bd6ddff2860b0557d90c0a21887%2F360TOCWFlow.png?alt=media" alt="" width="563"><figcaption></figcaption></figure>

Stream 360 highlights all lines connecting all the objects in this flow. It also opens a separate panel that displays additional details about the object, including queries that make use of that object.

In the simple example below, we selected the **users\_log** changelog. Its flow from object to enriched stream is highlighted, and details display in a panel on the right.

<figure><img src="https://1288764042-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fdbd9e6ZJodkgF1H6AVay%2Fuploads%2Fgit-blob-a0482b1ff7e693c76a81e6f83584d9a1cdb4524b%2FUsersChangelogSelected.png?alt=media" alt="" width="563"><figcaption></figcaption></figure>

And in this example, the final result – the **enriched pageviews** stream – is selected. The lines that represent the flow of all the objects involved in this enriched stream are highlighted, and details of the enriched stream display in the side panel.

<figure><img src="https://1288764042-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fdbd9e6ZJodkgF1H6AVay%2Fuploads%2Fgit-blob-94afcf31e2f362302d48fc0e536a5fa7f21676f0%2FEnrichedPVStreamSelected.png?alt=media" alt="" width="563"><figcaption></figcaption></figure>

Finally, you can enter an object name, in whole or in part, in the **Search** bar above the TOC to get details about a particular object.

### Moving DeltaStream Objects and Reorganizing Flows

You can rearrange the way your flows display in multiple ways. To do this, you can click and drag individual objects or use the buttons in the lower-left of the Stream 360 screen. Lines that connect an object with a query or destination move with the object — that is, changing the location of objects on the Stream 360 canvas does not break the flow; you're modifying the visual display only.

<figure><img src="https://1288764042-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fdbd9e6ZJodkgF1H6AVay%2Fuploads%2Fgit-blob-13a78117b5e6baa4cbb10c16d3a9157436d4970d%2FLower-LeftButtons.png?alt=media" alt="" width="285"><figcaption></figcaption></figure>

| To do this...                           | ...do this                                                                                                                                                                                                         |
| --------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| Move an object around on the canvas     | Click and drag the object.                                                                                                                                                                                         |
| Move multiple objects around as a group | **Ctrl click** (Windows) or **Cmd click** (Mac) the objects you want. Then click and drag the objects as a group.                                                                                                  |
| Increase the size of the objects        | Click **+**                                                                                                                                                                                                        |
| Decrease the size of the objects        | Click **-**                                                                                                                                                                                                        |
| Center the entire flow                  | Click ![](https://1288764042-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fdbd9e6ZJodkgF1H6AVay%2Fuploads%2Fgit-blob-f87c87583c597235286fb3bdc6fee46dfcaaad50%2F360Center.png?alt=media)     |
| Lock the objects in place               | Click ![](https://1288764042-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fdbd9e6ZJodkgF1H6AVay%2Fuploads%2Fgit-blob-3398193f21ac6b3a6515ec4d1c9d402662e4c73d%2F360LockToggle.png?alt=media) |
