For the complete documentation index, see llms.txt. This page is also available as Markdown.

Stream large rasters

Stream Cloud Optimized GeoTIFFs and STAC imagery into Felt, and name your bucket's files so you can search and filter them.

Stream terabyte-scale rasters from your bucket without uploading or copying them to Felt. Felt supports Cloud Optimized GeoTIFFs (COGs) and SpatioTemporal Asset Catalogs (STACs), and indexes your files by location and metadata so you can search and filter them. You can style the results like any raster layer.

Streamed rasters aren't limited by the upload file size, and they don't count toward your workspace's processing limit. See Data limits and Plan usage.

How streaming works

When raster streaming is on your plan, Felt tries to stream every COG you add from a bucket or a URL. If a file can't be streamed, for example because it isn't a valid COG, Felt uploads and processes it instead. The file then counts toward processing like any upload.

In a streamed layer's Data tab, Status reads Streaming. Felt reads the file from its location each time the map needs tiles, so a streamed layer can't be refreshed. To show newer imagery, add the new file to the map as its own layer, and then delete the old layer. See Refresh data.

Organize your raster data

For large raster collections, store Cloud Optimized GeoTIFFs in a bucket. Use a consistent path pattern that includes metadata about each file. See Extract attributes with regular expressions.

Three maps of streamed rasters: a land cover classification, building elevation in a city, and night lights.

Storage

Felt streams rasters from these buckets. Each connects as a data source:

Felt can also stream from any other location that serves files over HTTPS and supports range requests, which let Felt read only part of a file. If your Felt instance is self-hosted in your own virtual private cloud (VPC), storing data close to it reduces the delay in loading tiles.

Format

Felt can process many raster formats, but a Cloud Optimized GeoTIFF lets Felt read only the data you're viewing on the map. For the settings and commands to create one, see Cloud Optimized GeoTIFFs.

Structure

A strict naming pattern makes your files easy to find in Felt:

  • Use folders to organize files into projects.

  • Put the attributes you want to search by into each file's path.

For example, this naming pattern puts a project, a type, a date, and a resolution in each path:

A file that follows the pattern looks like this:

Extract attributes with regular expressions

Felt can use regular expressions to extract attributes from the paths of files in a bucket. In the bucket source's Extract attributes section, enter an Example file path, then click Add regex match for each attribute. Give each one a Regex, a Name, and a Type, such as a string, number, or date. The Example column shows what each regex matches in the example path.

For the naming pattern in Structure, extract project, type, date, and resolution to search and filter files by those attributes.

Extract properties table with an example file path and four regular expressions that extract project, type, date, and resolution.

STAC

A SpatioTemporal Asset Catalog (STAC) stores metadata in a defined format, including the area and time period each file covers. Use one when your metadata doesn't fit a naming pattern, or when you have a very large or frequently changing set of files. Felt can add both static STAC catalogs in JSON and dynamic STAC APIs as sources. See STAC.

Last updated

Was this helpful?