pub struct OrderedBatchIngestMetadata {
pub paths: Vec<PathBuf>,
pub last_path: Option<PathBuf>,
pub max_watermark_value: Option<Value>,
}Expand description
Metadata from ingest_from_ordered_paths: which paths were read, the last path in that
sequence, and (when incremental watermark options are set) the maximum value in the watermark
column after the batch filter — useful for checkpointing the next run.
Fields§
§paths: Vec<PathBuf>Files ingested, in the order given.
last_path: Option<PathBuf>Last entry in Self::paths (typical append-only batch cursor).
max_watermark_value: Option<Value>Maximum of the watermark column over non-null cells in the output dataset, when watermark
options were set; otherwise None.
Trait Implementations§
Source§impl Clone for OrderedBatchIngestMetadata
impl Clone for OrderedBatchIngestMetadata
Source§fn clone(&self) -> OrderedBatchIngestMetadata
fn clone(&self) -> OrderedBatchIngestMetadata
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for OrderedBatchIngestMetadata
impl Debug for OrderedBatchIngestMetadata
impl StructuralPartialEq for OrderedBatchIngestMetadata
Auto Trait Implementations§
impl Freeze for OrderedBatchIngestMetadata
impl RefUnwindSafe for OrderedBatchIngestMetadata
impl Send for OrderedBatchIngestMetadata
impl Sync for OrderedBatchIngestMetadata
impl Unpin for OrderedBatchIngestMetadata
impl UnsafeUnpin for OrderedBatchIngestMetadata
impl UnwindSafe for OrderedBatchIngestMetadata
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more