Struct Document 

pub struct Document {

    pub id: String,
    pub source: String,
    pub source_id: String,
    pub source_url: Option<String>,
    pub title: Option<String>,
    pub author: Option<String>,
    pub created_at: i64,
    pub updated_at: i64,
    pub content_type: String,
    pub body: String,
    pub metadata_json: String,
    pub raw_json: Option<String>,
    pub dedup_hash: String,
}

Normalized document stored in the documents table.

Created during ingestion by normalizing a SourceItem. Each document is uniquely identified by the (source, source_id) pair, and carries a dedup_hash (SHA-256 of source + source_id + updated_at + body) to detect content changes.

Timestamps are stored as Unix epoch seconds (i64) for efficient comparison and indexing.

Fields

id: String

UUID v4 primary key.

source: String

Connector name that produced this document.

source_id: String

Unique identifier within the source.

source_url: Option<String>

Web-browsable URL, if available.

title: Option<String>

Human-readable title.

author: Option<String>

Author from source metadata.

created_at: i64

Creation timestamp (Unix epoch seconds).

updated_at: i64

Last modification timestamp (Unix epoch seconds).

content_type: String

MIME content type.

body: String

Full text body.

metadata_json: String

Connector-specific metadata as JSON.

raw_json: Option<String>

Raw connector response.

dedup_hash: String

SHA-256 hash for deduplication: H(source || source_id || updated_at || body).

Trait Implementations

impl Clone for Document

fn clone(&self) -> Document

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Document

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.