Objectstore

These functions are used by OpenGHG to store and retrieve data from the object store. OpenGHG will call either local object store functions (that create an object store on disk) or cloud object store functions depending on its environment. Within the __init__.py of openghg.objectstore a check is made to see if the environment is the OpenGHG hub or a serverless function.

Local

These functions handle data storage on disk.

openghg.objectstore.delete_object(bucket, key)

Remove object at key in bucket

Parameters:

• bucket (str) – Bucket path

• key (str) – Key to data in bucket

Return type:

None

Returns:

None

openghg.objectstore.exists(bucket, key)

Checks if there is an object in the object store with the given key

Parameters:

• bucket (str) – Bucket containing data

• key (str) – Prefix for key in object store

Returns:

True if key exists in store

Return type:

bool

openghg.objectstore.get_all_object_names(bucket, prefix=None, without_prefix=False)

Returns the names of all objects in the passed bucket

Parameters:

• bucket (str) – Bucket path

• prefix (Optional[str]) – Prefix for keys

• without_prefix (bool) – If True don’t use prefix

Returns:

List of object names

Return type:

list

openghg.objectstore.get_bucket(name=None)

Find and return the local object store path. This will return the path to the user’s local object store if no name is given.

Parameters:

name (Optional[str]) – Object store name in config file

Returns:

Path to object store

Return type:

str

openghg.objectstore.get_object(bucket, key)

Gets the object at key in the passed bucket

Parameters:

• bucket (str) – Bucket containing data

• key (str) – Key for data in bucket

Returns:

Binary data from the store

Return type:

bytes

openghg.objectstore.get_object_from_json(bucket, key)

Return an object constructed from JSON stored at key.

Parameters:

• bucket (str) – Bucket containing data

• key (str) – Key for data in bucket

Returns:

Dictionary

Return type:

dict

openghg.objectstore.get_object_names(bucket, prefix=None)

List all the keys in the object store

Parameters:

bucket (str) – Bucket containing data

Returns:

List of keys in object store

Return type:

list

openghg.objectstore.get_tutorial_store_path()

Get the path to the local tutorial store

Returns:

Path of tutorial store

Return type:

pathlib.Path

openghg.objectstore.query_store()

Create a dictionary that can be used to visualise the object store

Returns:

Dictionary for data to be shown in force graph

Return type:

dict

openghg.objectstore.set_object(bucket, key, data)

Store data in bucket at key

Parameters:

• bucket (str) – Bucket path

• key (str) – Key to store data in bucket

• data (bytes) – Data in string form

Return type:

None

Returns:

None

openghg.objectstore.set_object_from_file(bucket, key, filename)

Set the contents of file at filename to key in bucket

Parameters:

• bucket (str) – Bucket path

• key (str) – Key to for data

• filename (str, pathlib.Path) – Filename/path

Return type:

None

Returns:

None

openghg.objectstore.set_object_from_json(bucket, key, data)

Set JSON data in the object store

Parameters:

• bucket (str) – Bucket for data storage

• key (str) – Key for data in bucket

• data (str | dict) – JSON serialised data string

Return type:

None

Returns:

None