Skip to main content

​
Dataset Management in DNAWave

​
Overview

DNAWave provides a robust dataset management system that allows users to upload, organize, and analyze genomic datasets efficiently. This guide covers how to create, edit, and manage datasets using the DNAWave platform.

​
Creating a Dataset

To create a dataset, navigate to the Dataset Creation Page and fill in the required fields.

​
Required Fields:

  • Name: A descriptive name for your dataset.
  • Description: Provide details about the dataset contents and purpose.
  • Dataset Type: Choose between Omics (genomics, transcriptomics, proteomics, etc.) or Research (scientific literature and studies).
  • Source: Select the storage type (S3 or Google Cloud Storage (GCS)).
  • Storage Path:
    • For S3, provide the S3 bucket URI.
    • For GCS, select a bucket and choose a file path.
  • Keywords: Enter relevant keywords to enhance AI-driven literature recommendations.
  • Tags: Categorize datasets for easy retrieval.

​
Viewing and Managing Datasets

Once a dataset is created, users can view and manage it from the Dataset View Page.

​
Dataset Details Page

The Dataset View Page provides an overview of the dataset, including:
  • Dataset metadata (Name, Description, Source, Type, Keywords, and Tags).
  • Storage details (S3/GCS paths and bucket information).
  • Workflow information (Linked workflows and versions).
  • Data Quality Score (Validation results for dataset integrity).
  • Literature Recommendations (AI-powered research paper suggestions).
  • File Management (Upload, Download, Delete, and Share dataset files).

​
Data Quality Validation

DNAWave includes an automated Data Quality Score Section that evaluates dataset files using key metrics:
  • Headers: Checks for missing or improperly formatted headers.
  • Duplicate Records: Identifies redundant entries.
  • Missing Data: Flags incomplete or empty fields.
Each metric is displayed with a percentage score, along with a visual progress bar indicating data quality.

​
Dataset Versioning

Users can track dataset modifications with Dataset Version History:
  • Each version logs changes, including timestamps and modification reasons.
  • Users can compare changes across versions.
  • Versions are linked to the user responsible for updates.

​
File Management

DNAWave supports robust dataset file management:
  • Upload Files: Add new files via the Dataset Upload Page.
  • Download Files: Retrieve dataset files securely.
  • Delete Files: Remove outdated or unnecessary files.
  • Share Files: Generate shareable links with expiration times.
  • File Validation: Perform automated quality checks on dataset files.

​
API Integration

Developers can programmatically manage datasets using the DNAWave REST API. The API allows users to:
  • Create and update datasets.
  • Manage dataset metadata.
  • Integrate with external analysis pipelines.
Refer to the API Documentation for further details.

​
Summary

The DNAWave Dataset Management System streamlines genomic data handling by providing an intuitive UI, secure storage integration, and AI-powered insights. Start managing your datasets today to accelerate your genomic research!