EventStore is available in Hex and can be installed as follows:
-
Add eventstore to your list of dependencies in
mix.exs
:def deps do [{:eventstore, "~> 1.4"}] end
Run
mix deps.get
to install the new dependency. -
Define an event store module for your application:
defmodule MyApp.EventStore do use EventStore, otp_app: :my_app # Optional `init/1` function to modify config at runtime. def init(config) do {:ok, config} end end
-
Add a config entry containing the PostgreSQL database connection details for your event store module to each environment's mix config file (e.g.
config/dev.exs
):config :my_app, MyApp.EventStore, serializer: EventStore.JsonSerializer, username: "postgres", password: "postgres", database: "eventstore", hostname: "localhost" # OR use a URL to connect instead config :my_app, MyApp.EventStore, serializer: EventStore.JsonSerializer, url: "postgres://postgres:postgres@localhost/eventstore"
Note: Some managed database providers (such as DigitalOcean) don't provide access to the default
postgres
database. In such case, you can specify a default database in the following way:config :my_app, MyApp.EventStore, default_database: "defaultdb",
Note: To use an EventStore with Commanded you should configure the event store to use Commanded's JSON serializer which provides additional support for JSON decoding:
config :my_app, MyApp.EventStore, serializer: Commanded.Serialization.JsonSerializer
Configure optional database connection settings:
config :my_app, MyApp.EventStore, pool_size: 10 queue_target: 50 queue_interval: 1_000, schema: "schema_name"
The database connection pool configuration options are:
:pool_size
- The number of connections (default:10
).
Handling requests is done through a queue. When DBConnection is started, there are two relevant options to control the queue:
:queue_target
- in milliseconds (default: 50ms).:queue_interval
- in milliseconds (default: 1,000ms).
Additional options:
:schema
- define the Postgres schema to use (default:public
schema).:timeout
- set the default database query timeout in milliseconds (default: 15,000ms).:shared_connection_pool
- allows a database connection pool to be shared amongst multiple event store instances (default:nil
).
Subscription options:
:subscription_retry_interval
- interval between subscription connection retry attempts (default: 60,000ms).:subscription_hibernate_after
- subscriptions will automatically hibernate to save memory after a period of inactivity (default: 15,000ms).
-
Add your event store module to the
event_stores
list for your app in mix config:# config/config.exs config :my_app, event_stores: [MyApp.EventStore]
This ensures the event store mix tasks can be run without specifying the event store as a command line argument (e.g.
mix event_store.init -e MyApp.EventStore
). -
Create and initialize the event store database and tables using the
mix
tasks:$ mix do event_store.create, event_store.init
-
The final piece of configuration is to setup your event store as a supervisor within your application's supervision tree (e.g. in
lib/my_app/application.ex
, inside thestart/2
function):defmodule MyApp.Application do use Application def start(_type, _args) do children = [ MyApp.EventStore ] opts = [strategy: :one_for_one, name: MyApp.Supervisor] Supervisor.start_link(children, opts) end end
You can use an existing PostgreSQL database with EventStore by running the following mix
task to create and initialize the event store tables:
$ mix event_store.init
To drop an existing EventStore database and recreate it you can run the following mix
tasks:
$ mix do event_store.drop, event_store.create, event_store.init
Warning This will drop the database and delete all data.
If you're using an Elixir release build by the task mix release you won't have mix
available therefore you won't be able to run the following command in order to initialize a new database.
$ mix do event_store.create, event_store.init
To do that you can use task modules defined inside EventStore (in lib/mix/tasks
):
So you can take advantage of the running one-off commands supported by Mix release, using a helper module defined like this:
defmodule MyApp.ReleaseTasks do
def init_event_store do
{:ok, _} = Application.ensure_all_started(:postgrex)
{:ok, _} = Application.ensure_all_started(:ssl)
:ok = Application.load(:my_app)
config = MyApp.EventStore.config()
:ok = EventStore.Tasks.Create.exec(config, [])
:ok = EventStore.Tasks.Init.exec(config, [])
end
end
A Postgres database contains one or more named schemas, which in turn contain tables. By default tables are defined in a schema named "public".
An EventStore can be configured to use a different schema name. Specify the schema when using the EventStore
macro in your event store module:
defmodule MyApp.EventStore do
use EventStore, otp_app: :my_app, schema: "example"
end
Or provide the schema as an option in the init/1
callback function:
defmodule MyApp.EventStore do
use EventStore, otp_app: :my_app
def init(config) do
{:ok, Keyword.put(config, :schema, "example")}
end
end
Or define it in environment config when configuring the database connection settings:
# config/config.exs
config :my_app, MyApp.EventStore, schema: "example"
This feature allows you to define and start multiple event stores sharing a single Postgres database, but with their data isolated and segregated by schema.
Note the mix event_store.<task>
tasks to create, initialize, and drop an event store database will also handle creating and/or dropping the schema.
EventStore has support for persisting event data and metadata as either:
- Binary data, using the
bytea
data type, designed for storing binary strings. - JSON data, using the
jsonb
data type, specifically designed for storing JSON encoded data.
The default data type is bytea
. This can be used with any binary serializer, such as the Erlang Term format, JSON data encoded to binary, and other serialization formats.
The advantage this format is that it allows you to execute ad-hoc SQL queries against the event data or metadata using PostgreSQL's native JSON query support.
To enable native JSON support you need to configure your event store to use the jsonb
data type. You must also use the EventStore.JsonbSerializer
serializer, to ensure event data and metadata is correctly serialized to JSON, and include the Postgres types module (EventStore.PostgresTypes
) for the Postgrex library to support JSON.
# config/config.exs
config :my_app, MyApp.EventStore,
column_data_type: "jsonb",
serializer: EventStore.JsonbSerializer,
types: EventStore.PostgresTypes
Finally, you need to include the Jason library as a dependency in mix.exs
to enable Postgrex JSON support and then run mix deps.get
to install.
# mix.exs
defp deps do
[{:jason, "~> 1.2"}]
end
These settings must be configured before creating the EventStore database. It's not possible to migrate between bytea
and jsonb
data types once you've created the database. This must be decided in advance.
EventStore uses LISTEN/NOTIFY
and pg_advisory_locks
Postgres capabilities. Unfortunately, they are not compatible with PgBouncer running in transaction (most typical) mode.
As a workaround, you can provide an additional session_mode_url
parameter to the EventStore config:
config :my_app, MyApp.EventStore,
url: "postgres://postgres:pgbouncer-in-transaction-mode@localhost/eventstore"
session_mode_url: "postgres://postgres:pgbouncer-in-session-mode@localhost/eventstore"
This will allow the EventStore to use your regular pool settings to connect to the database defined in url
for most database operations. It will separately establish connections using the session_mode_url
where necessary which you should point to PgBouncer in session mode or connected directly to the Postgres instance.