Version 10.0.2
All Classes Functions Variables Typedefs Enumerations Enumerator Modules Pages
WT_CONNECTION Struct Reference

A connection to a WiredTiger database. More...

Public Member Functions

int close (WT_HANDLE_CLOSED(WT_CONNECTION) *connection, const char *config)
 Close a connection. More...
 
int reconfigure (WT_CONNECTION *connection, const char *config)
 Reconfigure a connection handle. More...
 
const char * get_home (WT_CONNECTION *connection)
 The home directory of the connection. More...
 
int configure_method (WT_CONNECTION *connection, const char *method, const char *uri, const char *config, const char *type, const char *check)
 Add configuration options for a method. More...
 
int is_new (WT_CONNECTION *connection)
 Return if opening this handle created the database. More...
 
Session handles
int open_session (WT_CONNECTION *connection, WT_EVENT_HANDLER *event_handler, const char *config, WT_SESSION **sessionp)
 Open a session. More...
 
Transactions
int query_timestamp (WT_CONNECTION *connection, char *hex_timestamp, const char *config)
 Query the global transaction timestamp state. More...
 
int set_timestamp (WT_CONNECTION *connection, const char *config)
 Set a global transaction timestamp. More...
 
int rollback_to_stable (WT_CONNECTION *connection, const char *config)
 Rollback in-memory non-logged state to an earlier point in time. More...
 
Extensions
int load_extension (WT_CONNECTION *connection, const char *path, const char *config)
 Load an extension. More...
 
int add_data_source (WT_CONNECTION *connection, const char *prefix, WT_DATA_SOURCE *data_source, const char *config)
 Add a custom data source. More...
 
int add_collator (WT_CONNECTION *connection, const char *name, WT_COLLATOR *collator, const char *config)
 Add a custom collation function. More...
 
int add_compressor (WT_CONNECTION *connection, const char *name, WT_COMPRESSOR *compressor, const char *config)
 Add a compression function. More...
 
int add_encryptor (WT_CONNECTION *connection, const char *name, WT_ENCRYPTOR *encryptor, const char *config)
 Add an encryption function. More...
 
int add_extractor (WT_CONNECTION *connection, const char *name, WT_EXTRACTOR *extractor, const char *config)
 Add a custom extractor for index keys or column groups. More...
 
int set_file_system (WT_CONNECTION *connection, WT_FILE_SYSTEM *fs, const char *config)
 Configure a custom file system. More...
 
WT_EXTENSION_APIget_extension_api (WT_CONNECTION *wt_conn)
 Return a reference to the WiredTiger extension functions. More...
 

Detailed Description

A connection to a WiredTiger database.

The connection may be opened within the same address space as the caller or accessed over a socket connection.

Most applications will open a single connection to a database for each process. The first process to open a connection to a database will access the database in its own address space. Subsequent connections (if allowed) will communicate with the first process over a socket connection to perform their operations.

Thread safety: A WT_CONNECTION handle may be shared between threads, see Multithreading for more information.

Examples
ex_access.c, ex_backup.c, ex_backup_block.c, ex_call_center.c, ex_col_store.c, ex_cursor.c, ex_encrypt.c, ex_extending.c, ex_extractor.c, ex_file_system.c, ex_hello.c, ex_log.c, ex_pack.c, ex_schema.c, ex_stat.c, ex_thread.c, nop_encrypt.c, rotn_encrypt.c, and sodium_encrypt.c.

Member Function Documentation

◆ add_collator()

int WT_CONNECTION::add_collator ( WT_CONNECTION connection,
const char *  name,
WT_COLLATOR collator,
const char *  config 
)

Add a custom collation function.

The application must first implement the WT_COLLATOR interface and then register the implementation with WiredTiger:

static WT_COLLATOR my_collator = {my_compare, NULL, NULL};
error_check(conn->add_collator(conn, "my_collator", &my_collator, NULL));
Parameters
connectionthe connection handle
namethe name of the collation to be used in calls to WT_SESSION::create, may not be "none"
collatorthe application-supplied collation handler
configconfiguration string, see Configuration Strings. No values currently permitted.
Returns
zero on success and a non-zero error code on failure. See Error handling for details.
Examples
ex_extending.c.

◆ add_compressor()

int WT_CONNECTION::add_compressor ( WT_CONNECTION connection,
const char *  name,
WT_COMPRESSOR compressor,
const char *  config 
)

Add a compression function.

The application must first implement the WT_COMPRESSOR interface and then register the implementation with WiredTiger:

/* Local compressor structure. */
typedef struct {
WT_COMPRESSOR compressor; /* Must come first */
WT_EXTENSION_API *wt_api; /* Extension API */
unsigned long nop_calls; /* Count of calls */
} NOP_COMPRESSOR;
/*
* wiredtiger_extension_init --
* A simple shared library compression example.
*/
int
{
NOP_COMPRESSOR *nop_compressor;
int ret;
(void)config; /* Unused parameters */
if ((nop_compressor = calloc(1, sizeof(NOP_COMPRESSOR))) == NULL)
return (errno);
/*
* Allocate a local compressor structure, with a WT_COMPRESSOR structure as the first field,
* allowing us to treat references to either type of structure as a reference to the other type.
*
* Heap memory (not static), because it can support multiple databases.
*/
nop_compressor->compressor.compress = nop_compress;
nop_compressor->compressor.decompress = nop_decompress;
nop_compressor->compressor.pre_size = nop_pre_size;
nop_compressor->compressor.terminate = nop_terminate;
nop_compressor->wt_api = connection->get_extension_api(connection);
/* Load the compressor */
if ((ret = connection->add_compressor(
connection, "nop", (WT_COMPRESSOR *)nop_compressor, NULL)) == 0)
return (0);
free(nop_compressor);
return (ret);
}
Parameters
connectionthe connection handle
namethe name of the compression function to be used in calls to WT_SESSION::create, may not be "none"
compressorthe application-supplied compression handler
configconfiguration string, see Configuration Strings. No values currently permitted.
Returns
zero on success and a non-zero error code on failure. See Error handling for details.

◆ add_data_source()

int WT_CONNECTION::add_data_source ( WT_CONNECTION connection,
const char *  prefix,
WT_DATA_SOURCE data_source,
const char *  config 
)

Add a custom data source.

See Custom Data Sources for more information.

The application must first implement the WT_DATA_SOURCE interface and then register the implementation with WiredTiger:

static WT_DATA_SOURCE my_dsrc = {my_alter, my_create, my_compact, my_drop, my_open_cursor,
my_rename, my_salvage, my_size, my_truncate, my_range_truncate, my_verify, my_checkpoint,
my_terminate, my_lsm_pre_merge};
error_check(conn->add_data_source(conn, "dsrc:", &my_dsrc, NULL));
Parameters
connectionthe connection handle
prefixthe URI prefix for this data source, e.g., "file:"
data_sourcethe application-supplied implementation of WT_DATA_SOURCE to manage this data source.
configconfiguration string, see Configuration Strings. No values currently permitted.
Returns
zero on success and a non-zero error code on failure. See Error handling for details.

◆ add_encryptor()

int WT_CONNECTION::add_encryptor ( WT_CONNECTION connection,
const char *  name,
WT_ENCRYPTOR encryptor,
const char *  config 
)

Add an encryption function.

The application must first implement the WT_ENCRYPTOR interface and then register the implementation with WiredTiger:

/* Local encryptor structure. */
typedef struct {
WT_ENCRYPTOR encryptor; /* Must come first */
WT_EXTENSION_API *wt_api; /* Extension API */
unsigned long nop_calls; /* Count of calls */
} NOP_ENCRYPTOR;
/*
* wiredtiger_extension_init --
* A simple shared library encryption example.
*/
int
{
NOP_ENCRYPTOR *nop_encryptor;
int ret;
(void)config; /* Unused parameters */
if ((nop_encryptor = calloc(1, sizeof(NOP_ENCRYPTOR))) == NULL)
return (errno);
/*
* Allocate a local encryptor structure, with a WT_ENCRYPTOR structure as the first field,
* allowing us to treat references to either type of structure as a reference to the other type.
*
* Heap memory (not static), because it can support multiple databases.
*/
nop_encryptor->encryptor.encrypt = nop_encrypt;
nop_encryptor->encryptor.decrypt = nop_decrypt;
nop_encryptor->encryptor.sizing = nop_sizing;
nop_encryptor->encryptor.customize = nop_customize;
nop_encryptor->encryptor.terminate = nop_terminate;
nop_encryptor->wt_api = connection->get_extension_api(connection);
/* Load the encryptor */
if ((ret = connection->add_encryptor(connection, "nop", (WT_ENCRYPTOR *)nop_encryptor, NULL)) ==
0)
return (0);
free(nop_encryptor);
return (ret);
}
Parameters
connectionthe connection handle
namethe name of the encryption function to be used in calls to WT_SESSION::create, may not be "none"
encryptorthe application-supplied encryption handler
configconfiguration string, see Configuration Strings. No values currently permitted.
Returns
zero on success and a non-zero error code on failure. See Error handling for details.
Examples
ex_encrypt.c, nop_encrypt.c, rotn_encrypt.c, and sodium_encrypt.c.

◆ add_extractor()

int WT_CONNECTION::add_extractor ( WT_CONNECTION connection,
const char *  name,
WT_EXTRACTOR extractor,
const char *  config 
)

Add a custom extractor for index keys or column groups.

The application must first implement the WT_EXTRACTOR interface and then register the implementation with WiredTiger:

static WT_EXTRACTOR my_extractor = {my_extract, NULL, NULL};
error_check(conn->add_extractor(conn, "my_extractor", &my_extractor, NULL));
Parameters
connectionthe connection handle
namethe name of the extractor to be used in calls to WT_SESSION::create, may not be "none"
extractorthe application-supplied extractor
configconfiguration string, see Configuration Strings. No values currently permitted.
Returns
zero on success and a non-zero error code on failure. See Error handling for details.
Examples
ex_extractor.c.

◆ close()

int WT_CONNECTION::close ( WT_HANDLE_CLOSED(WT_CONNECTION) *  connection,
const char *  config 
)

Close a connection.

Any open sessions will be closed. This will release the resources associated with the session handle, including rolling back any active transactions and closing any cursors that remain open in the session.

error_check(conn->close(conn, NULL));
Parameters
connectionthe connection handle
configconfiguration string, see Configuration Strings. Permitted values:
NameEffectValues
leak_memorydon't free memory during close.a boolean flag; default false.
use_timestampby default, create the close checkpoint as of the last stable timestamp if timestamps are in use, or all current updates if there is no stable timestamp set. If false, this option generates a checkpoint with all updates.a boolean flag; default true.
Returns
zero on success and a non-zero error code on failure. See Error handling for details.
Examples
ex_access.c, ex_backup.c, ex_call_center.c, ex_col_store.c, ex_cursor.c, ex_encrypt.c, ex_extending.c, ex_extractor.c, ex_file_system.c, ex_hello.c, ex_log.c, ex_pack.c, ex_schema.c, ex_stat.c, and ex_thread.c.

◆ configure_method()

int WT_CONNECTION::configure_method ( WT_CONNECTION connection,
const char *  method,
const char *  uri,
const char *  config,
const char *  type,
const char *  check 
)

Add configuration options for a method.

See Creating data-specific configuration strings for more information.

/*
* Applications opening a cursor for the data-source object "my_data" have an additional
* configuration option "entries", which is an integer type, defaults to 5, and must be an
* integer between 1 and 10.
*
* The method being configured is specified using a concatenation of the handle name, a period
* and the method name.
*/
error_check(conn->configure_method(
conn, "WT_SESSION.open_cursor", "my_data:", "entries=5", "int", "min=1,max=10"));
/*
* Applications opening a cursor for the data-source object "my_data" have an additional
* configuration option "devices", which is a list of strings.
*/
error_check(
conn->configure_method(conn, "WT_SESSION.open_cursor", "my_data:", "devices", "list", NULL));
Parameters
connectionthe connection handle
methodthe method being configured
urithe object type or NULL for all object types
configthe additional configuration's name and default value
typethe additional configuration's type (must be one of "boolean"\, "int", "list" or "string")
checkthe additional configuration check string, or NULL if none
Returns
zero on success and a non-zero error code on failure. See Error handling for details.

◆ get_extension_api()

WT_EXTENSION_API* WT_CONNECTION::get_extension_api ( WT_CONNECTION wt_conn)

Return a reference to the WiredTiger extension functions.

#include <wiredtiger_ext.h>
static WT_EXTENSION_API *wt_api;
static void
my_data_source_init(WT_CONNECTION *connection)
{
wt_api = connection->get_extension_api(connection);
}
Parameters
wt_connthe WT_CONNECTION handle
Returns
a reference to a WT_EXTENSION_API structure.
Examples
ex_encrypt.c, ex_file_system.c, nop_encrypt.c, rotn_encrypt.c, and sodium_encrypt.c.

◆ get_home()

const char* WT_CONNECTION::get_home ( WT_CONNECTION connection)

The home directory of the connection.

printf("The database home is %s\n", conn->get_home(conn));
Parameters
connectionthe connection handle
Returns
a pointer to a string naming the home directory

◆ is_new()

int WT_CONNECTION::is_new ( WT_CONNECTION connection)

Return if opening this handle created the database.

if (conn->is_new(conn)) {
/* First time initialization. */
}
Parameters
connectionthe connection handle
Returns
false (zero) if the connection existed before the call to wiredtiger_open, true (non-zero) if it was created by opening this handle.

◆ load_extension()

int WT_CONNECTION::load_extension ( WT_CONNECTION connection,
const char *  path,
const char *  config 
)

Load an extension.

error_check(conn->load_extension(conn, "my_extension.dll", NULL));
error_check(conn->load_extension(
conn, "datasource/libdatasource.so", "config=[device=/dev/sd1,alignment=64]"));
Parameters
connectionthe connection handle
paththe filename of the extension module, or "local" to search the current application binary for the initialization function, see Extending WiredTiger for more details.
configconfiguration string, see Configuration Strings. Permitted values:
NameEffectValues
configconfiguration string passed to the entry point of the extension as its WT_CONFIG_ARG argument.a string; default empty.
early_loadwhether this extension should be loaded at the beginning of wiredtiger_open. Only applicable to extensions loaded via the wiredtiger_open configurations string.a boolean flag; default false.
entrythe entry point of the extension, called to initialize the extension when it is loaded. The signature of the function must match wiredtiger_extension_init.a string; default wiredtiger_extension_init.
terminatean optional function in the extension that is called before the extension is unloaded during WT_CONNECTION::close. The signature of the function must match wiredtiger_extension_terminate.a string; default wiredtiger_extension_terminate.
Returns
zero on success and a non-zero error code on failure. See Error handling for details.

◆ open_session()

int WT_CONNECTION::open_session ( WT_CONNECTION connection,
WT_EVENT_HANDLER event_handler,
const char *  config,
WT_SESSION **  sessionp 
)

Open a session.

WT_SESSION *session;
error_check(conn->open_session(conn, NULL, NULL, &session));
Parameters
connectionthe connection handle
event_handlerAn event handler. If NULL, the connection's event handler is used. See Message handling using the WT_EVENT_HANDLER for more information.
configconfiguration string, see Configuration Strings. Permitted values:
NameEffectValues
cache_cursorsenable caching of cursors for reuse. Any calls to WT_CURSOR::close for a cursor created in this session will mark the cursor as cached and keep it available to be reused for later calls to WT_SESSION::open_cursor. Cached cursors may be eventually closed. This value is inherited from wiredtiger_open cache_cursors.a boolean flag; default true.
cache_max_wait_msthe maximum number of milliseconds an application thread will wait for space to be available in cache before giving up. Default value will be the global setting of the connection config.an integer greater than or equal to 0; default 0.
ignore_cache_sizewhen set, operations performed by this session ignore the cache size and are not blocked when the cache is full. Note that use of this option for operations that create cache pressure can starve ordinary sessions that obey the cache size.a boolean flag; default false.
isolationthe default isolation level for operations in this session.a string, chosen from the following options: "read-uncommitted", "read-committed", "snapshot"; default snapshot.
[out]sessionpthe new session handle
Returns
zero on success and a non-zero error code on failure. See Error handling for details.
Examples
ex_access.c, ex_backup.c, ex_call_center.c, ex_col_store.c, ex_cursor.c, ex_encrypt.c, ex_extending.c, ex_extractor.c, ex_file_system.c, ex_hello.c, ex_log.c, ex_pack.c, ex_schema.c, ex_stat.c, and ex_thread.c.

◆ query_timestamp()

int WT_CONNECTION::query_timestamp ( WT_CONNECTION connection,
char *  hex_timestamp,
const char *  config 
)

Query the global transaction timestamp state.

char timestamp_buf[2 * sizeof(uint64_t) + 1];
error_check(session->timestamp_transaction(session, "commit_timestamp=2a"));
error_check(session->commit_transaction(session, NULL));
error_check(conn->query_timestamp(conn, timestamp_buf, "get=all_durable"));
Parameters
connectionthe connection handle
[out]hex_timestampa buffer that will be set to the hexadecimal encoding of the timestamp being queried. Must be large enough to hold a NUL terminated, hex-encoded 8B timestamp (17 bytes).
configconfiguration string, see Configuration Strings. Permitted values:
NameEffectValues
getspecify which timestamp to query: all_durable returns the largest timestamp such that all timestamps up to that value have been made durable, last_checkpoint returns the timestamp of the most recent stable checkpoint, oldest returns the most recent oldest_timestamp set with WT_CONNECTION::set_timestamp, oldest_reader returns the minimum of the read timestamps of all active readers pinned returns the minimum of the oldest_timestamp and the read timestamps of all active readers, recovery returns the timestamp of the most recent stable checkpoint taken prior to a shutdown and stable returns the most recent stable_timestamp set with WT_CONNECTION::set_timestamp. See Application-specified Transaction Timestamps.a string, chosen from the following options: "all_durable", "last_checkpoint", "oldest", "oldest_reader", "pinned", "recovery", "stable"; default all_durable.
Returns
zero on success and a non-zero error code on failure. See Error handling for details. If there is no matching timestamp (e.g., if this method is called before timestamps are used) WT_NOTFOUND will be returned.

◆ reconfigure()

int WT_CONNECTION::reconfigure ( WT_CONNECTION connection,
const char *  config 
)

Reconfigure a connection handle.

error_check(conn->reconfigure(conn, "eviction_target=75"));
Parameters
connectionthe connection handle
configconfiguration string, see Configuration Strings. Permitted values:
NameEffectValues
block_cache = (block cache configuration options.a set of related configuration options defined below.
     blkcache_eviction_aggressionseconds an unused block remains in the cache before it is evicted.an integer between 1 and 7200; default 1800.
    cache_on_checkpointcache blocks written by a checkpoint.a boolean flag; default true.
     cache_on_writescache blocks as they are written (other than checkpoint blocks).a boolean flag; default true.
    enabledenable block cache.a boolean flag; default false.
    full_targetthe fraction of the block cache that must be full before eviction will remove unused blocks.an integer between 30 and 100; default 95.
     hashsizenumber of buckets in the hashtable that keeps track of blocks.an integer between 512 and 256K; default 0.
     max_percent_overheadmaximum tolerated overhead expressed as the number of blocks added and removed as percent of blocks looked up; cache population and eviction will be suppressed if the overhead exceeds the threshold.an integer between 1 and 500; default 10.
    nvram_paththe absolute path to the file system mounted on the NVRAM device.a string; default empty.
     percent_file_in_drambypass cache for a file if the set percentage of the file fits in system DRAM (as specified by block_cache.system_ram).an integer between 0 and 100; default 50.
    sizemaximum memory to allocate for the block cache.an integer between 0 and 10TB; default 0.
    system_ramthe bytes of system DRAM available for caching filesystem blocks.an integer between 0 and 1024GB; default 0.
    typecache location: DRAM or NVRAM.a string; default empty.
)
cache_max_wait_msthe maximum number of milliseconds an application thread will wait for space to be available in cache before giving up. Default will wait forever.an integer greater than or equal to 0; default 0.
cache_overheadassume the heap allocator overhead is the specified percentage, and adjust the cache usage by that amount (for example, if there is 10GB of data in cache, a percentage of 10 means WiredTiger treats this as 11GB). This value is configurable because different heap allocators have different overhead and different workloads will have different heap allocation sizes and patterns, therefore applications may need to adjust this value based on allocator choice and behavior in measured workloads.an integer between 0 and 30; default 8.
cache_sizemaximum heap memory to allocate for the cache. A database should configure either cache_size or shared_cache but not both.an integer between 1MB and 10TB; default 100MB.
checkpoint = (periodically checkpoint the database. Enabling the checkpoint server uses a session from the configured session_max.a set of related configuration options defined below.
    log_sizewait for this amount of log record bytes to be written to the log between each checkpoint. If non-zero, this value will use a minimum of the log file size. A database can configure both log_size and wait to set an upper bound for checkpoints; setting this value above 0 configures periodic checkpoints.an integer between 0 and 2GB; default 0.
    waitseconds to wait between each checkpoint; setting this value above 0 configures periodic checkpoints.an integer between 0 and 100000; default 0.
)
compatibility = (set compatibility version of database. Changing the compatibility version requires that there are no active operations for the duration of the call.a set of related configuration options defined below.
    releasecompatibility release version string.a string; default empty.
)
debug_mode = (control the settings of various extended debugging features.a set of related configuration options defined below.
     checkpoint_retentionadjust log archiving to retain the log records of this number of checkpoints. Zero or one means perform normal archiving.an integer between 0 and 1024; default 0.
    corruption_abortif true, dump the core in the diagnostic mode on encountering the data corruption.a boolean flag; default true.
    cursor_copyif true, use the system allocator to make a copy of any data returned by a cursor operation and return the copy instead. The copy is freed on the next cursor operation. This allows memory sanitizers to detect inappropriate references to memory owned by cursors.a boolean flag; default false.
    evictionif true, modify internal algorithms to change skew to force history store eviction to happen more aggressively. This includes but is not limited to not skewing newest, not favoring leaf pages, and modifying the eviction score mechanism.a boolean flag; default false.
     log_retentionadjust log archiving to retain at least this number of log files, ignored if set to 0. (Warning: this option can remove log files required for recovery if no checkpoints have yet been done and the number of log files exceeds the configured value. As WiredTiger cannot detect the difference between a system that has not yet checkpointed and one that will never checkpoint, it might discard log files before any checkpoint is done.).an integer between 0 and 1024; default 0.
     realloc_exactif true, reallocation of memory will only provide the exact amount requested. This will help with spotting memory allocation issues more easily.a boolean flag; default false.
    rollback_errorreturn a WT_ROLLBACK error from a transaction operation about every Nth operation to simulate a collision.an integer between 0 and 10M; default 0.
     slow_checkpointif true, slow down checkpoint creation by slowing down internal page processing.a boolean flag; default false.
     table_loggingif true, write transaction related information to the log for all operations, even operations for tables with logging turned off. This setting introduces a log format change that may break older versions of WiredTiger. These operations are informational and skipped in recovery.a boolean flag; default false.
    update_restore_evictif true, control all dirty page evictions through forcing update restore eviction.a boolean flag; default false.
)
error_prefixprefix string for error messages.a string; default empty.
eviction = (eviction configuration options.a set of related configuration options defined below.
    threads_maxmaximum number of threads WiredTiger will start to help evict pages from cache. The number of threads started will vary depending on the current eviction load. Each eviction worker thread uses a session from the configured session_max.an integer between 1 and 20; default 8.
    threads_minminimum number of threads WiredTiger will start to help evict pages from cache. The number of threads currently running will vary depending on the current eviction load.an integer between 1 and 20; default 1.
)
eviction_checkpoint_targetperform eviction at the beginning of checkpoints to bring the dirty content in cache to this level. It is a percentage of the cache size if the value is within the range of 0 to 100 or an absolute size when greater than 100. The value is not allowed to exceed the cache_size. Ignored if set to zero.an integer between 0 and 10TB; default 1.
eviction_dirty_targetperform eviction in worker threads when the cache contains at least this much dirty content. It is a percentage of the cache size if the value is within the range of 1 to 100 or an absolute size when greater than 100. The value is not allowed to exceed the cache_size and has to be lower than its counterpart eviction_dirty_trigger.an integer between 1 and 10TB; default 5.
eviction_dirty_triggertrigger application threads to perform eviction when the cache contains at least this much dirty content. It is a percentage of the cache size if the value is within the range of 1 to 100 or an absolute size when greater than 100. The value is not allowed to exceed the cache_size and has to be greater than its counterpart eviction_dirty_target. This setting only alters behavior if it is lower than eviction_trigger.an integer between 1 and 10TB; default 20.
eviction_targetperform eviction in worker threads when the cache contains at least this much content. It is a percentage of the cache size if the value is within the range of 10 to 100 or an absolute size when greater than 100. The value is not allowed to exceed the cache_size and has to be lower than its counterpart eviction_trigger.an integer between 10 and 10TB; default 80.
eviction_triggertrigger application threads to perform eviction when the cache contains at least this much content. It is a percentage of the cache size if the value is within the range of 10 to 100 or an absolute size when greater than 100. The value is not allowed to exceed the cache_size and has to be greater than its counterpart eviction_target.an integer between 10 and 10TB; default 95.
eviction_updates_targetperform eviction in worker threads when the cache contains at least this many bytes of updates. It is a percentage of the cache size if the value is within the range of 0 to 100 or an absolute size when greater than 100. Calculated as half of eviction_dirty_target by default. The value is not allowed to exceed the cache_size and has to be lower than its counterpart eviction_updates_trigger.an integer between 0 and 10TB; default 0.
eviction_updates_triggertrigger application threads to perform eviction when the cache contains at least this many bytes of updates. It is a percentage of the cache size if the value is within the range of 1 to 100 or an absolute size when greater than 100. Calculated as half of eviction_dirty_trigger by default. The value is not allowed to exceed the cache_size and has to be greater than its counterpart eviction_updates_target. This setting only alters behavior if it is lower than eviction_trigger.an integer between 0 and 10TB; default 0.
file_manager = (control how file handles are managed.a set of related configuration options defined below.
     close_handle_minimumnumber of handles open before the file manager will look for handles to close.an integer greater than or equal to 0; default 250.
    close_idle_timeamount of time in seconds a file handle needs to be idle before attempting to close it. A setting of 0 means that idle handles are not closed.an integer between 0 and 100000; default 30.
    close_scan_intervalinterval in seconds at which to check for files that are inactive and close them.an integer between 1 and 100000; default 10.
)
history_store = (history store configuration options.a set of related configuration options defined below.
    file_maxThe maximum number of bytes that WiredTiger is allowed to use for its history store mechanism. If the history store file exceeds this size, a panic will be triggered. The default value means that the history store file is unbounded and may use as much space as the filesystem will accommodate. The minimum non-zero setting is 100MB.an integer greater than or equal to 0; default 0.
)
io_capacity = (control how many bytes per second are written and read. Exceeding the capacity results in throttling.a set of related configuration options defined below.
    totalnumber of bytes per second available to all subsystems in total. When set, decisions about what subsystems are throttled, and in what proportion, are made internally. The minimum non-zero setting is 1MB.an integer between 0 and 1TB; default 0.
)
log = (enable logging. Enabling logging uses three sessions from the configured session_max.a set of related configuration options defined below.
    archiveautomatically archive unneeded log files.a boolean flag; default true.
    os_cache_dirty_pctmaximum dirty system buffer cache usage, as a percentage of the log's file_max. If non-zero, schedule writes for dirty blocks belonging to the log in the system buffer cache after that percentage of the log has been written into the buffer cache without an intervening file sync.an integer between 0 and 100; default 0.
    preallocpre-allocate log files.a boolean flag; default true.
    zero_fillmanually write zeroes into log files.a boolean flag; default false.
)
lsm_manager = (configure database wide options for LSM tree management. The LSM manager is started automatically the first time an LSM tree is opened. The LSM manager uses a session from the configured session_max.a set of related configuration options defined below.
    mergemerge LSM chunks where possible.a boolean flag; default true.
     worker_thread_maxConfigure a set of threads to manage merging LSM trees in the database. Each worker thread uses a session handle from the configured session_max.an integer between 3 and 20; default 4.
)
operation_timeout_mswhen non-zero, a requested limit on the number of elapsed real time milliseconds application threads will take to complete database operations. Time is measured from the start of each WiredTiger API call. There is no guarantee any operation will not take longer than this amount of time. If WiredTiger notices the limit has been exceeded, an operation may return a WT_ROLLBACK error. Default is to have no limit.an integer greater than or equal to 1; default 0.
operation_tracking = (enable tracking of performance-critical functions. See Track function calls for more information.a set of related configuration options defined below.
    enabledenable operation tracking subsystem.a boolean flag; default false.
    paththe name of a directory into which operation tracking files are written. The directory must already exist. If the value is not an absolute path, the path is relative to the database home (see Absolute paths for more information).a string; default ".".
)
shared_cache = (shared cache configuration options. A database should configure either a cache_size or a shared_cache not both. Enabling a shared cache uses a session from the configured session_max. A shared cache can not have absolute values configured for cache eviction settings.a set of related configuration options defined below.
    chunkthe granularity that a shared cache is redistributed.an integer between 1MB and 10TB; default 10MB.
    namethe name of a cache that is shared between databases or "none" when no shared cache is configured.a string; default none.
    quotamaximum size of cache this database can be allocated from the shared cache. Defaults to the entire shared cache size.an integer; default 0.
    reserveamount of cache this database is guaranteed to have available from the shared cache. This setting is per database. Defaults to the chunk size.an integer; default 0.
     sizemaximum memory to allocate for the shared cache. Setting this will update the value if one is already set.an integer between 1MB and 10TB; default 500MB.
)
statisticsMaintain database statistics, which may impact performance. Choosing "all" maintains all statistics regardless of cost, "fast" maintains a subset of statistics that are relatively inexpensive, "none" turns off all statistics. The "clear" configuration resets statistics after they are gathered, where appropriate (for example, a cache size statistic is not cleared, while the count of cursor insert operations will be cleared). When "clear" is configured for the database, gathered statistics are reset each time a statistics cursor is used to gather statistics, as well as each time statistics are logged using the statistics_log configuration. See Statistics for more information.a list, with values chosen from the following options: "all", "cache_walk", "fast", "none", "clear", "tree_walk"; default none.
statistics_log = (log any statistics the database is configured to maintain, to a file. See Statistics for more information. Enabling the statistics log server uses a session from the configured session_max.a set of related configuration options defined below.
    jsonencode statistics in JSON format.a boolean flag; default false.
    on_closelog statistics on database close.a boolean flag; default false.
    sourcesif non-empty, include statistics for the list of data source URIs, if they are open at the time of the statistics logging. The list may include URIs matching a single data source ("table:mytable"), or a URI matching all data sources of a particular type ("table:").a list of strings; default empty.
    timestampa timestamp prepended to each log record, may contain strftime conversion specifications, when json is configured, defaults to "%Y-%m-%dT%H:%M:%S.000Z".a string; default "%b %d %H:%M:%S".
    waitseconds to wait between each write of the log records; setting this value above 0 configures statistics logging.an integer between 0 and 100000; default 0.
)
tiered_storage = (enable tiered storage. Enabling tiered storage may use one session from the configured session_max.a set of related configuration options defined below.
    local_retentiontime in seconds to retain data on tiered storage on the local tier for faster read access.an integer between 0 and 10000; default 300.
)
verboseenable messages for various subsystems and operations. Options are given as a list, where each message type can optionally define an associated verbosity level, such as "verbose=[evictserver,read:1,rts:0]". Verbosity levels that can be provided include 0 (INFO) and 1 (DEBUG).a list, with values chosen from the following options: "api", "backup", "block", "block_cache", "checkpoint", "checkpoint_cleanup", "checkpoint_progress", "compact", "compact_progress", "error_returns", "evict", "evict_stuck", "evictserver", "fileops", "handleops", "history_store", "history_store_activity", "log", "lsm", "lsm_manager", "metadata", "mutex", "overflow", "read", "reconcile", "recovery", "recovery_progress", "rts", "salvage", "shared_cache", "split", "temporary", "thread_group", "tiered", "timestamp", "transaction", "verify", "version", "write"; default [].
Returns
zero on success and a non-zero error code on failure. See Error handling for details.

◆ rollback_to_stable()

int WT_CONNECTION::rollback_to_stable ( WT_CONNECTION connection,
const char *  config 
)

Rollback in-memory non-logged state to an earlier point in time.

This method uses a timestamp to define the rollback point, and requires the application use timestamps, the stable_timestamp have been set via a call to WT_CONNECTION::set_timestamp, and a checkpoint operating on the last stable timestamp to have completed. Any updates to checkpoint durable tables that are more recent than the stable timestamp are removed.

This method requires that there are no open cursors or active operations for the duration of the call.

Any updates made to logged tables will not be rolled back. Any updates made without an associated timestamp will not be rolled back. See Application-specified Transaction Timestamps.

error_check(conn->rollback_to_stable(conn, NULL));
Parameters
connectionthe connection handle
configconfiguration string, see Configuration Strings. No values currently permitted.
Returns
zero on success and a non-zero error code on failure. See Error handling for details. An error should occur only in the case of a system problem, and an application typically will retry WT_CONNECTION::rollback_to_stable on error, or fail outright.

◆ set_file_system()

int WT_CONNECTION::set_file_system ( WT_CONNECTION connection,
WT_FILE_SYSTEM fs,
const char *  config 
)

Configure a custom file system.

This method can only be called from an early loaded extension module. The application must first implement the WT_FILE_SYSTEM interface and then register the implementation with WiredTiger:

/*
* Setup a configuration string that will load our custom file system. Use the special local
* extension to indicate that the entry point is in the same executable. Also enable early load
* for this extension, since WiredTiger needs to be able to find it before doing any file
* operations. Finally, pass in two pieces of configuration information to our initialization
* function as the "config" value.
*/
open_config =
"create,log=(enabled=true),extensions=(local={entry=demo_file_system_create,early_load=true,"
"config={config_string=\"demo-file-system\",config_value=37}})";
/* Open a connection to the database, creating it if necessary. */
if ((ret = wiredtiger_open(home, NULL, open_config, &conn)) != 0) {
fprintf(stderr, "Error connecting to %s: %s\n", home == NULL ? "." : home,
return (EXIT_FAILURE);
}
Parameters
connectionthe connection handle
fsthe populated file system structure
configconfiguration string, see Configuration Strings. No values currently permitted.
Returns
zero on success and a non-zero error code on failure. See Error handling for details.
Examples
ex_file_system.c.

◆ set_timestamp()

int WT_CONNECTION::set_timestamp ( WT_CONNECTION connection,
const char *  config 
)

Set a global transaction timestamp.

error_check(conn->set_timestamp(conn, "commit_timestamp=2a"));
error_check(conn->set_timestamp(conn, "oldest_timestamp=2a"));
error_check(conn->set_timestamp(conn, "stable_timestamp=2a"));
Parameters
connectionthe connection handle
configconfiguration string, see Configuration Strings. Permitted values:
NameEffectValues
commit_timestamp(deprecated) reset the maximum commit timestamp tracked by WiredTiger. This will cause future calls to WT_CONNECTION::query_timestamp to ignore commit timestamps greater than the specified value until the next commit moves the tracked commit timestamp forwards. This is only intended for use where the application is rolling back locally committed transactions. The supplied value must not be older than the current oldest and stable timestamps. See Application-specified Transaction Timestamps.a string; default empty.
durable_timestampreset the maximum durable timestamp tracked by WiredTiger. This will cause future calls to WT_CONNECTION::query_timestamp to ignore durable timestamps greater than the specified value until the next durable timestamp moves the tracked durable timestamp forwards. This is only intended for use where the application is rolling back locally committed transactions. The value must not be older than the current oldest and stable timestamps. See Application-specified Transaction Timestamps.a string; default empty.
forceset timestamps even if they violate normal ordering requirements. For example allow the oldest_timestamp to move backwards.a boolean flag; default false.
oldest_timestampfuture commits and queries will be no earlier than the specified timestamp. Values must be monotonically increasing, any attempt to set the value to older than the current is silently ignored. The value must not be newer than the current stable timestamp. See Application-specified Transaction Timestamps.a string; default empty.
stable_timestampcheckpoints will not include commits that are newer than the specified timestamp in tables configured with log=(enabled=false). Values must be monotonically increasing, any attempt to set the value to older than the current is silently ignored. The value must not be older than the current oldest timestamp. See Application-specified Transaction Timestamps.a string; default empty.
Returns
zero on success and a non-zero error code on failure. See Error handling for details.
WT_EXTENSION_API
Table of WiredTiger extension methods.
Definition: wiredtiger_ext.h:94
WT_CONNECTION::get_home
const char * get_home(WT_CONNECTION *connection)
The home directory of the connection.
WT_SESSION::timestamp_transaction
int timestamp_transaction(WT_SESSION *session, const char *config)
Set a timestamp on a transaction.
wiredtiger_strerror
const char * wiredtiger_strerror(int error)
Return information about a WiredTiger error as a string (see WT_SESSION::strerror for a thread-safe A...
WT_DATA_SOURCE
Applications can extend WiredTiger by providing new implementations of the WT_DATA_SOURCE class.
Definition: wiredtiger.in:4082
WT_CONNECTION::rollback_to_stable
int rollback_to_stable(WT_CONNECTION *connection, const char *config)
Rollback in-memory non-logged state to an earlier point in time.
WT_COLLATOR
The interface implemented by applications to provide custom ordering of records.
Definition: wiredtiger.in:3880
WT_SESSION::commit_transaction
int commit_transaction(WT_SESSION *session, const char *config)
Commit the current transaction.
WT_CONFIG_ARG
struct WT_CONFIG_ARG WT_CONFIG_ARG
Definition: wiredtiger.in:3866
WT_CONNECTION::get_extension_api
WT_EXTENSION_API * get_extension_api(WT_CONNECTION *wt_conn)
Return a reference to the WiredTiger extension functions.
WT_CONNECTION::add_extractor
int add_extractor(WT_CONNECTION *connection, const char *name, WT_EXTRACTOR *extractor, const char *config)
Add a custom extractor for index keys or column groups.
WT_ENCRYPTOR
The interface implemented by applications to provide custom encryption.
Definition: wiredtiger.in:4220
WT_CONNECTION::open_session
int open_session(WT_CONNECTION *connection, WT_EVENT_HANDLER *event_handler, const char *config, WT_SESSION **sessionp)
Open a session.
WT_CONNECTION::is_new
int is_new(WT_CONNECTION *connection)
Return if opening this handle created the database.
WT_CONNECTION::set_timestamp
int set_timestamp(WT_CONNECTION *connection, const char *config)
Set a global transaction timestamp.
WT_CONNECTION::add_collator
int add_collator(WT_CONNECTION *connection, const char *name, WT_COLLATOR *collator, const char *config)
Add a custom collation function.
wiredtiger_extension_init
int wiredtiger_extension_init(WT_CONNECTION *connection, WT_CONFIG_ARG *config)
Entry point to an extension, called when the extension is loaded.
WT_CONNECTION
A connection to a WiredTiger database.
Definition: wiredtiger.in:2019
WT_CONNECTION::add_encryptor
int add_encryptor(WT_CONNECTION *connection, const char *name, WT_ENCRYPTOR *encryptor, const char *config)
Add an encryption function.
WT_EXTRACTOR
The interface implemented by applications to provide custom extraction of index keys or column group ...
Definition: wiredtiger.in:4378
WT_CONNECTION::close
int close(WT_HANDLE_CLOSED(WT_CONNECTION) *connection, const char *config)
Close a connection.
WT_CONNECTION::configure_method
int configure_method(WT_CONNECTION *connection, const char *method, const char *uri, const char *config, const char *type, const char *check)
Add configuration options for a method.
WT_CONNECTION::add_data_source
int add_data_source(WT_CONNECTION *connection, const char *prefix, WT_DATA_SOURCE *data_source, const char *config)
Add a custom data source.
WT_CONNECTION::add_compressor
int add_compressor(WT_CONNECTION *connection, const char *name, WT_COMPRESSOR *compressor, const char *config)
Add a compression function.
wiredtiger_open
int wiredtiger_open(const char *home, WT_EVENT_HANDLER *event_handler, const char *config, WT_CONNECTION **connectionp)
Open a connection to a database.
WT_COMPRESSOR
The interface implemented by applications to provide custom compression.
Definition: wiredtiger.in:3933
WT_CONNECTION::query_timestamp
int query_timestamp(WT_CONNECTION *connection, char *hex_timestamp, const char *config)
Query the global transaction timestamp state.
WT_CONNECTION::reconfigure
int reconfigure(WT_CONNECTION *connection, const char *config)
Reconfigure a connection handle.
WT_SESSION
All data operations are performed in the context of a WT_SESSION.
Definition: wiredtiger.in:762
WT_CONNECTION::load_extension
int load_extension(WT_CONNECTION *connection, const char *path, const char *config)
Load an extension.