crowdsecurity / example-docker-compose Goto Github PK

Example integration of crowdsec in docker-compose

HTML 2.76% Dockerfile 97.24%

example-docker-compose's Introduction

In this repository we will be showing multiple examples on how to use CrowdSec within container environments.

The idea is to show how to use CrowdSec in different scenarios, from the most basic to more complex ones. These examples can be used out of the box or as a base to build your own solution.

Name	Description
Standard	Old example please read top of README.md
Container Socket	Example reading logs from container socket
Container Labels	Example reading logs from containers using labels as discovery
Journald	Example reading logs from journald
Swag	Example protecting SWAG
NPM	Example protecting NPM (Nginx Proxy Manager)
Caddy	Example protecting Caddy
ELK	Example reading logs from ELK stack (Logstash)

Would you like to contribute an example you didn't see here? or just found a mistake you would like to fix? Please open a PR and we will review it as soon as possible.

example-docker-compose's People

Contributors

Stargazers

Watchers

example-docker-compose's Issues

metabase password ?

what is the metabase default password please ?

Metabase: [SQLITE_CANTOPEN] Unable to open the database file

I have set up my docker compose similar to the example, but Metabase is unable to show any dashboard resources citing the error "[SQLITE_CANTOPEN] Unable to open the database file"

Log:

Warning: environ value jdk-11.0.14+9 for key :java-version has been overwritten with 11.0.14
WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance.
2022-02-16 09:50:58,925 INFO metabase.util :: Maximum memory available to JVM: 15.7 GB
2022-02-16 09:51:12,217 INFO util.encryption :: Saved credentials encryption is DISABLED for this Metabase instance. 🔓 
 For more information, see https://metabase.com/docs/latest/operations-guide/encrypting-database-details-at-rest.html
2022-02-16 09:51:15,174 INFO driver.impl :: Registered abstract driver :sql  🚚
 ⮦ Load driver :sql took 699.2 ms
2022-02-16 09:51:15,185 INFO driver.impl :: Registered abstract driver :sql-jdbc (parents: [:sql]) 🚚
Load driver :sql-jdbc took 715.2 ms
2022-02-16 09:51:15,190 INFO driver.impl :: Registered driver :h2 (parents: [:sql-jdbc]) 🚚
2022-02-16 09:51:15,212 INFO driver.impl :: Registered driver :mysql (parents: [:sql-jdbc]) 🚚
2022-02-16 09:51:15,232 INFO driver.impl :: Registered driver :postgres (parents: [:sql-jdbc]) 🚚
2022-02-16 09:51:17,780 INFO metabase.core :: 
Metabase v0.42.0 (de1264e release-x.42.x) 

Copyright © 2022 Metabase, Inc. 

Metabase Enterprise Edition extensions are NOT PRESENT.
2022-02-16 09:51:17,790 INFO metabase.core :: Starting Metabase in STANDALONE mode
2022-02-16 09:51:17,833 INFO metabase.server :: Launching Embedded Jetty Webserver with config: 
 {:port 3000, :host "0.0.0.0"}

2022-02-16 09:51:17,871 INFO metabase.core :: Starting Metabase version v0.42.0 (de1264e release-x.42.x) ...
2022-02-16 09:51:17,912 INFO metabase.core :: System info:
 {"file.encoding" "UTF-8",
 "java.runtime.name" "OpenJDK Runtime Environment",
 "java.runtime.version" "11.0.14+9",
 "java.vendor" "Eclipse Adoptium",
 "java.vendor.url" "https://adoptium.net/",
 "java.version" "11.0.14",
 "java.vm.name" "OpenJDK 64-Bit Server VM",
 "java.vm.version" "11.0.14+9",
 "os.name" "Linux",
 "os.version" "5.13.19-2-pve",
 "user.language" "en",
 "user.timezone" "GMT"}

2022-02-16 09:51:17,913 INFO metabase.plugins :: Loading plugins in /plugins...
2022-02-16 09:51:18,122 INFO util.files :: Extract file /modules/googleanalytics.metabase-driver.jar -> /plugins/googleanalytics.metabase-driver.jar
2022-02-16 09:51:18,136 INFO util.files :: Extract file /modules/presto-jdbc.metabase-driver.jar -> /plugins/presto-jdbc.metabase-driver.jar
2022-02-16 09:51:18,216 INFO util.files :: Extract file /modules/redshift.metabase-driver.jar -> /plugins/redshift.metabase-driver.jar
2022-02-16 09:51:18,226 INFO util.files :: Extract file /modules/sparksql.metabase-driver.jar -> /plugins/sparksql.metabase-driver.jar
2022-02-16 09:51:18,603 INFO util.files :: Extract file /modules/oracle.metabase-driver.jar -> /plugins/oracle.metabase-driver.jar
2022-02-16 09:51:18,605 INFO util.files :: Extract file /modules/sqlite.metabase-driver.jar -> /plugins/sqlite.metabase-driver.jar
2022-02-16 09:51:18,627 INFO util.files :: Extract file /modules/vertica.metabase-driver.jar -> /plugins/vertica.metabase-driver.jar
2022-02-16 09:51:18,628 INFO util.files :: Extract file /modules/snowflake.metabase-driver.jar -> /plugins/snowflake.metabase-driver.jar
2022-02-16 09:51:18,829 INFO util.files :: Extract file /modules/presto-common.metabase-driver.jar -> /plugins/presto-common.metabase-driver.jar
2022-02-16 09:51:18,830 INFO util.files :: Extract file /modules/druid.metabase-driver.jar -> /plugins/druid.metabase-driver.jar
2022-02-16 09:51:18,835 INFO util.files :: Extract file /modules/google.metabase-driver.jar -> /plugins/google.metabase-driver.jar
2022-02-16 09:51:18,846 INFO util.files :: Extract file /modules/presto.metabase-driver.jar -> /plugins/presto.metabase-driver.jar
2022-02-16 09:51:18,848 INFO util.files :: Extract file /modules/mongo.metabase-driver.jar -> /plugins/mongo.metabase-driver.jar
2022-02-16 09:51:18,870 INFO util.files :: Extract file /modules/sqlserver.metabase-driver.jar -> /plugins/sqlserver.metabase-driver.jar
2022-02-16 09:51:18,881 INFO util.files :: Extract file /modules/bigquery.metabase-driver.jar -> /plugins/bigquery.metabase-driver.jar
2022-02-16 09:51:18,887 INFO util.files :: Extract file /modules/bigquery-cloud-sdk.metabase-driver.jar -> /plugins/bigquery-cloud-sdk.metabase-driver.jar
2022-02-16 09:51:19,160 INFO plugins.dependencies :: Metabase cannot initialize plugin Metabase Oracle Driver due to required dependencies. Metabase requires the Oracle JDBC driver in order to connect to Oracle databases, but we can't ship it as part of Metabase due to licensing restrictions. See https://metabase.com/docs/latest/administration-guide/databases/oracle.html for more details.

2022-02-16 09:51:19,162 INFO plugins.dependencies :: Metabase Oracle Driver dependency {:class oracle.jdbc.OracleDriver} satisfied? false
2022-02-16 09:51:19,169 INFO plugins.dependencies :: Plugins with unsatisfied deps: ["Metabase Oracle Driver"]
2022-02-16 09:51:19,201 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :snowflake...
2022-02-16 09:51:19,202 INFO driver.impl :: Registered driver :snowflake (parents: [:sql-jdbc]) 🚚
2022-02-16 09:51:19,208 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :sqlserver...
2022-02-16 09:51:19,209 INFO driver.impl :: Registered driver :sqlserver (parents: [:sql-jdbc]) 🚚
2022-02-16 09:51:19,214 INFO plugins.dependencies :: Metabase cannot initialize plugin Metabase Vertica Driver due to required dependencies. Metabase requires the Vertica JDBC driver in order to connect to Vertica databases, but we can't ship it as part of Metabase due to licensing restrictions. See https://metabase.com/docs/latest/administration-guide/databases/vertica.html for more details.

2022-02-16 09:51:19,215 INFO plugins.dependencies :: Metabase Vertica Driver dependency {:class com.vertica.jdbc.Driver} satisfied? false
2022-02-16 09:51:19,216 INFO plugins.dependencies :: Plugins with unsatisfied deps: ["Metabase Vertica Driver" "Metabase Oracle Driver"]
2022-02-16 09:51:19,221 INFO plugins.dependencies :: Plugin 'Metabase Presto Driver' depends on plugin 'Presto Common Driver'
2022-02-16 09:51:19,221 INFO plugins.dependencies :: Metabase Presto Driver dependency {:plugin Presto Common Driver} satisfied? false
2022-02-16 09:51:19,222 INFO plugins.dependencies :: Plugins with unsatisfied deps: ["Metabase Vertica Driver" "Metabase Oracle Driver" "Metabase Presto Driver"]
2022-02-16 09:51:19,225 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :sqlite...
2022-02-16 09:51:19,226 INFO driver.impl :: Registered driver :sqlite (parents: [:sql-jdbc]) 🚚
2022-02-16 09:51:19,230 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :presto-common...
2022-02-16 09:51:19,230 INFO driver.impl :: Registered abstract driver :presto-common  🚚
2022-02-16 09:51:19,231 INFO plugins.dependencies :: Metabase Presto Driver dependency {:plugin Presto Common Driver} satisfied? true
2022-02-16 09:51:19,232 DEBUG plugins.initialize :: Dependencies satisfied; these plugins will now be loaded: ["Metabase Presto Driver"]
2022-02-16 09:51:19,233 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :presto...
2022-02-16 09:51:19,233 INFO driver.impl :: Registered driver :presto (parents: [:presto-common]) 🚚
2022-02-16 09:51:19,241 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :mongo...
2022-02-16 09:51:19,241 INFO driver.impl :: Registered driver :mongo  🚚
2022-02-16 09:51:19,246 INFO plugins.dependencies :: Plugin 'Metabase BigQuery Driver' depends on plugin 'Metabase Google Drivers Shared Dependencies'
2022-02-16 09:51:19,246 INFO plugins.dependencies :: Metabase BigQuery Driver dependency {:plugin Metabase Google Drivers Shared Dependencies} satisfied? false
2022-02-16 09:51:19,247 INFO plugins.dependencies :: Plugins with unsatisfied deps: ["Metabase Vertica Driver" "Metabase BigQuery Driver" "Metabase Oracle Driver"]
2022-02-16 09:51:19,250 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :google...
2022-02-16 09:51:19,250 INFO driver.impl :: Registered abstract driver :google  🚚
2022-02-16 09:51:19,251 INFO plugins.dependencies :: Metabase BigQuery Driver dependency {:plugin Metabase Google Drivers Shared Dependencies} satisfied? true
2022-02-16 09:51:19,252 DEBUG plugins.initialize :: Dependencies satisfied; these plugins will now be loaded: ["Metabase BigQuery Driver"]
2022-02-16 09:51:19,253 WARN plugins.lazy-loaded-driver :: Warning: plugin manifest for :bigquery does not include connection properties
2022-02-16 09:51:19,253 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :bigquery...
2022-02-16 09:51:19,253 INFO driver.impl :: Registered driver :bigquery (parents: [:sql :google]) 🚚
2022-02-16 09:51:19,258 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :redshift...
2022-02-16 09:51:19,259 INFO driver.impl :: Registered driver :redshift (parents: [:postgres]) 🚚
2022-02-16 09:51:19,265 INFO plugins.dependencies :: Plugin 'Metabase Google Analytics Driver' depends on plugin 'Metabase Google Drivers Shared Dependencies'
2022-02-16 09:51:19,266 INFO plugins.dependencies :: Metabase Google Analytics Driver dependency {:plugin Metabase Google Drivers Shared Dependencies} satisfied? true
2022-02-16 09:51:19,267 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :googleanalytics...
2022-02-16 09:51:19,268 INFO driver.impl :: Registered driver :googleanalytics (parents: [:google]) 🚚
2022-02-16 09:51:19,273 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :druid...
2022-02-16 09:51:19,273 INFO driver.impl :: Registered driver :druid  🚚
2022-02-16 09:51:19,312 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :hive-like...
2022-02-16 09:51:19,313 INFO driver.impl :: Registered abstract driver :hive-like (parents: [:sql-jdbc]) 🚚
2022-02-16 09:51:19,314 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :sparksql...
2022-02-16 09:51:19,314 INFO driver.impl :: Registered driver :sparksql (parents: [:hive-like]) 🚚
2022-02-16 09:51:19,330 INFO plugins.dependencies :: Plugin 'Metabase Presto JDBC Driver' depends on plugin 'Presto Common Driver'
2022-02-16 09:51:19,331 INFO plugins.dependencies :: Metabase Presto JDBC Driver dependency {:plugin Presto Common Driver} satisfied? true
2022-02-16 09:51:19,331 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :presto-jdbc...
2022-02-16 09:51:19,332 INFO driver.impl :: Registered driver :presto-jdbc (parents: [:presto-common]) 🚚
2022-02-16 09:51:19,342 DEBUG plugins.lazy-loaded-driver :: Registering lazy loading driver :bigquery-cloud-sdk...
2022-02-16 09:51:19,343 INFO driver.impl :: Registered driver :bigquery-cloud-sdk (parents: [:sql]) 🚚
2022-02-16 09:51:19,344 INFO metabase.core :: Setting up and migrating Metabase DB. Please sit tight, this may take a minute...
2022-02-16 09:51:19,346 WARN db.env :: WARNING: Using Metabase with an H2 application database is not recommended for production deployments. For production deployments, we highly recommend using Postgres, MySQL, or MariaDB instead. If you decide to continue to use H2, please be sure to back up the database file regularly. For more information, see https://metabase.com/docs/latest/operations-guide/migrating-from-h2.html
2022-02-16 09:51:19,350 INFO db.setup :: Verifying h2 Database Connection ...
2022-02-16 09:51:19,696 INFO db.setup :: Successfully verified H2 1.4.197 (2018-03-18) application database connection. ✅
2022-02-16 09:51:19,696 INFO db.setup :: Running Database Migrations...
2022-02-16 09:51:19,698 INFO db.setup :: Setting up Liquibase...
2022-02-16 09:51:19,742 INFO db.setup :: Liquibase is ready.
2022-02-16 09:51:19,743 INFO db.liquibase :: Checking if Database has unrun migrations...
2022-02-16 09:51:21,510 INFO db.liquibase :: Database has unrun migrations. Waiting for migration lock to be cleared...
2022-02-16 09:51:21,538 INFO db.liquibase :: Migration lock is cleared. Running migrations...
2022-02-16 09:51:22,840 INFO db.setup :: Database Migrations Current ...  ✅
2022-02-16 09:51:22,862 INFO db.data-migrations :: Running all necessary data migrations, this may take a minute.
2022-02-16 09:51:22,874 INFO db.data-migrations :: Running data migration 'migrate-click-through'...
2022-02-16 09:51:22,892 INFO db.data-migrations :: Finished running data migrations.
Database setup took 3.5 s
2022-02-16 09:51:23,089 INFO metabase.events :: Starting events listener: :metabase.events.dependencies/Dependencies 👂
2022-02-16 09:51:23,096 INFO metabase.events :: Starting events listener: :metabase.events.activity-feed/ActivityFeed 👂
2022-02-16 09:51:23,098 INFO metabase.events :: Starting events listener: :metabase.events.last-login/LastLogin 👂
2022-02-16 09:51:23,099 INFO metabase.events :: Starting events listener: :metabase.events.notifications/Notifications 👂
2022-02-16 09:51:23,100 INFO metabase.events :: Starting events listener: :metabase.events.sync-database/Sync 👂
2022-02-16 09:51:23,101 INFO metabase.events :: Starting events listener: :metabase.events.driver-notifications/DriverNotifications 👂
2022-02-16 09:51:23,101 INFO metabase.events :: Starting events listener: :metabase.events.revision/Revisions 👂
2022-02-16 09:51:23,102 INFO metabase.events :: Starting events listener: :metabase.events.view-log/ViewLog 👂
2022-02-16 09:51:23,365 INFO metabase.task :: Initializing task SyncDatabases 📆
2022-02-16 09:51:23,482 INFO task.send-pulses :: Sending scheduled pulses...
2022-02-16 09:51:23,536 INFO models.database :: :sqlite Database 'Crowdsec' sync/analyze schedules have changed! 
 Sync metadata was: '0 0 * * * ? *' is now: '0 1 * * * ? *' 
 Cache FieldValues was: '0 0 0 * * ? *', is now: '0 0 0 * * ? *'
2022-02-16 09:51:23,569 INFO task.sync-databases :: Scheduling sync/analyze for database 2: trigger: metabase.task.sync-and-analyze.trigger.2
2022-02-16 09:51:23,576 INFO driver.impl :: Initializing driver :sql...
2022-02-16 09:51:23,577 INFO driver.impl :: Initializing driver :sql-jdbc...
2022-02-16 09:51:23,578 INFO driver.impl :: Initializing driver :h2...
2022-02-16 09:51:23,602 INFO metabase.task :: Initializing task CheckForNewVersions 📆
2022-02-16 09:51:23,616 INFO metabase.task :: Initializing task SendAnonymousUsageStats 📆
2022-02-16 09:51:23,624 INFO metabase.task :: Initializing task SendAbandomentEmails 📆
2022-02-16 09:51:23,633 INFO metabase.task :: Initializing task SendPulses 📆
2022-02-16 09:51:23,640 INFO metabase.task :: Initializing task SendFollowUpEmails 📆
2022-02-16 09:51:23,648 INFO metabase.task :: Initializing task TaskHistoryCleanup 📆
2022-02-16 09:51:23,658 INFO metabase.core :: Metabase Initialization COMPLETE
2022-02-16 09:51:42,415 DEBUG middleware.log :: POST /api/dataset 401 4.2 ms (0 DB calls) 
"Unauthenticated"

2022-02-16 09:51:55,473 DEBUG middleware.log :: POST /api/session 200 1.3 s (7 DB calls) App DB connections: 0/7 Jetty threads: 6/50 (1 idle, 0 queued) (39 total active threads) Queries in flight: 0 (0 queued)
2022-02-16 09:51:55,579 INFO i18n.impl :: Reading available locales from locales.clj...
2022-02-16 09:51:55,617 DEBUG middleware.log :: GET /api/session/properties 200 89.0 ms (13 DB calls) App DB connections: 0/7 Jetty threads: 7/50 (0 idle, 0 queued) (39 total active threads) Queries in flight: 0 (0 queued)
2022-02-16 09:51:55,817 DEBUG middleware.log :: GET /api/user/current 200 304.3 ms (4 DB calls) App DB connections: 0/7 Jetty threads: 6/50 (1 idle, 0 queued) (40 total active threads) Queries in flight: 0 (0 queued)
2022-02-16 09:52:04,883 INFO driver.impl :: Initializing driver :sqlite...
2022-02-16 09:52:04,885 INFO plugins.classloader :: Added URL file:/plugins/sqlite.metabase-driver.jar to classpath
2022-02-16 09:52:04,885 DEBUG plugins.init-steps :: Loading plugin namespace metabase.driver.sqlite...
2022-02-16 09:52:04,892 INFO driver.impl :: Registered driver :sqlite (parents: [:sql-jdbc]) 🚚
2022-02-16 09:52:04,913 DEBUG plugins.jdbc-proxy :: Registering JDBC proxy driver for org.sqlite.JDBC...
Load lazy loading driver :sqlite took 28.6 ms
2022-02-16 09:52:36,073 ERROR middleware.catch-exceptions :: Error processing query: null
{:database_id 2,
 :started_at #t "2022-02-16T09:52:04.853145Z[GMT]",
 :via
 [{:status :failed,
   :class com.mchange.v2.resourcepool.CannotAcquireResourceException,
   :error "A ResourcePool could not acquire a resource from its primary factory or source.",
   :stacktrace
   ["com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1507)"
    "com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:644)"
    "com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:554)"
    "com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutAndMarkConnectionInUse(C3P0PooledConnectionPool.java:758)"
    "com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:685)"
    "com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:140)"
    "--> driver.sqlite$fn__95428.invokeStatic(sqlite.clj:355)"
    "driver.sqlite$fn__95428.invoke(sqlite.clj:353)"
    "driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:499)"
    "driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:487)"
    "driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:496)"
    "driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:487)"
    "driver.sql_jdbc$fn__81915.invokeStatic(sql_jdbc.clj:54)"
    "driver.sql_jdbc$fn__81915.invoke(sql_jdbc.clj:52)"
    "query_processor.context$executef.invokeStatic(context.clj:59)"
    "query_processor.context$executef.invoke(context.clj:48)"
    "query_processor.context.default$default_runf.invokeStatic(default.clj:68)"
    "query_processor.context.default$default_runf.invoke(default.clj:66)"
    "query_processor.context$runf.invokeStatic(context.clj:45)"
    "query_processor.context$runf.invoke(context.clj:39)"
    "query_processor.reducible$pivot.invokeStatic(reducible.clj:34)"
    "query_processor.reducible$pivot.invoke(reducible.clj:31)"
    "query_processor.middleware.mbql_to_native$mbql__GT_native$fn__49659.invoke(mbql_to_native.clj:25)"
    "query_processor.middleware.check_features$check_features$fn__50405.invoke(check_features.clj:42)"
    "query_processor.middleware.limit$limit$fn__48032.invoke(limit.clj:37)"
    "query_processor.middleware.cache$maybe_return_cached_results$fn__50788.invoke(cache.clj:204)"
    "query_processor.middleware.optimize_temporal_filters$optimize_temporal_filters$fn__51821.invoke(optimize_temporal_filters.clj:204)"
    "query_processor.middleware.validate_temporal_bucketing$validate_temporal_bucketing$fn__51865.invoke(validate_temporal_bucketing.clj:50)"
    "query_processor.middleware.auto_parse_filter_values$auto_parse_filter_values$fn__49716.invoke(auto_parse_filter_values.clj:43)"
    "query_processor.middleware.wrap_value_literals$wrap_value_literals$fn__39821.invoke(wrap_value_literals.clj:161)"
    "query_processor.middleware.annotate$add_column_info$fn__44587.invoke(annotate.clj:659)"
    "query_processor.middleware.permissions$check_query_permissions$fn__46329.invoke(permissions.clj:108)"
    "query_processor.middleware.pre_alias_aggregations$pre_alias_aggregations$fn__51010.invoke(pre_alias_aggregations.clj:40)"
    "query_processor.middleware.cumulative_aggregations$handle_cumulative_aggregations$fn__46725.invoke(cumulative_aggregations.clj:60)"
    "query_processor.middleware.visualization_settings$update_viz_settings$fn__46663.invoke(visualization_settings.clj:63)"
    "query_processor.middleware.fix_bad_references$fix_bad_references_middleware$fn__50975.invoke(fix_bad_references.clj:91)"
    "query_processor.middleware.resolve_joined_fields$resolve_joined_fields$fn__47610.invoke(resolve_joined_fields.clj:111)"
    "query_processor.middleware.resolve_joins$resolve_joins$fn__51591.invoke(resolve_joins.clj:176)"
    "query_processor.middleware.add_implicit_joins$add_implicit_joins$fn__51133.invoke(add_implicit_joins.clj:202)"
    "query_processor.middleware.large_int_id$convert_id_to_string$fn__47629.invoke(large_int_id.clj:59)"
    "query_processor.middleware.format_rows$format_rows$fn__51185.invoke(format_rows.clj:74)"
    "query_processor.middleware.add_default_temporal_unit$add_default_temporal_unit$fn__46997.invoke(add_default_temporal_unit.clj:23)"
    "query_processor.middleware.desugar$desugar$fn__46636.invoke(desugar.clj:21)"
    "query_processor.middleware.binning$update_binning_strategy$fn__39550.invoke(binning.clj:229)"
    "query_processor.middleware.resolve_fields$resolve_fields$fn__45971.invoke(resolve_fields.clj:34)"
    "query_processor.middleware.add_dimension_projections$add_remapping$fn__50342.invoke(add_dimension_projections.clj:487)"
    "query_processor.middleware.add_implicit_clauses$add_implicit_clauses$fn__50636.invoke(add_implicit_clauses.clj:164)"
    "query_processor.middleware.upgrade_field_literals$upgrade_field_literals$fn__48017.invoke(upgrade_field_literals.clj:117)"
    "query_processor.middleware.add_source_metadata$add_source_metadata_for_source_queries$fn__47374.invoke(add_source_metadata.clj:125)"
    "query_processor.middleware.reconcile_breakout_and_order_by_bucketing$reconcile_breakout_and_order_by_bucketing$fn__50887.invoke(reconcile_breakout_and_order_by_bucketing.clj:100)"
    "query_processor.middleware.auto_bucket_datetimes$auto_bucket_datetimes$fn__48974.invoke(auto_bucket_datetimes.clj:147)"
    "query_processor.middleware.resolve_source_table$resolve_source_tables$fn__45952.invoke(resolve_source_table.clj:45)"
    "query_processor.middleware.parameters$substitute_parameters$fn__48628.invoke(parameters.clj:111)"
    "query_processor.middleware.resolve_referenced$resolve_referenced_card_resources$fn__46025.invoke(resolve_referenced.clj:79)"
    "query_processor.middleware.expand_macros$expand_macros$fn__52249.invoke(expand_macros.clj:184)"
    "query_processor.middleware.add_timezone_info$add_timezone_info$fn__48407.invoke(add_timezone_info.clj:15)"
    "query_processor.middleware.splice_params_in_response$splice_params_in_response$fn__51200.invoke(splice_params_in_response.clj:32)"
    "query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__50647$fn__50652.invoke(resolve_database_and_driver.clj:35)"
    "driver$do_with_driver.invokeStatic(driver.clj:60)"
    "driver$do_with_driver.invoke(driver.clj:56)"
    "query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__50647.invoke(resolve_database_and_driver.clj:34)"
    "query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__46571.invoke(fetch_source_query.clj:286)"
    "query_processor.middleware.store$initialize_store$fn__46762$fn__46763.invoke(store.clj:11)"
    "query_processor.store$do_with_store.invokeStatic(store.clj:44)"
    "query_processor.store$do_with_store.invoke(store.clj:38)"
    "query_processor.middleware.store$initialize_store$fn__46762.invoke(store.clj:10)"
    "query_processor.middleware.validate$validate_query$fn__50982.invoke(validate.clj:10)"
    "query_processor.middleware.normalize_query$normalize$fn__50989.invoke(normalize_query.clj:22)"
    "query_processor.middleware.add_rows_truncated$add_rows_truncated$fn__48353.invoke(add_rows_truncated.clj:35)"
    "query_processor.middleware.results_metadata$record_and_return_metadata_BANG_$fn__49645.invoke(results_metadata.clj:82)"
    "query_processor.middleware.constraints$add_default_userland_constraints$fn__48371.invoke(constraints.clj:42)"
    "query_processor.middleware.process_userland_query$process_userland_query$fn__50923.invoke(process_userland_query.clj:146)"
    "query_processor.middleware.catch_exceptions$catch_exceptions$fn__51280.invoke(catch_exceptions.clj:169)"
    "query_processor.reducible$async_qp$qp_STAR___43323$thunk__43324.invoke(reducible.clj:103)"
    "query_processor.reducible$async_qp$qp_STAR___43323.invoke(reducible.clj:109)"
    "query_processor.reducible$sync_qp$qp_STAR___43332$fn__43335.invoke(reducible.clj:135)"
    "query_processor.reducible$sync_qp$qp_STAR___43332.invoke(reducible.clj:134)"
    "query_processor$process_userland_query.invokeStatic(query_processor.clj:245)"
    "query_processor$process_userland_query.doInvoke(query_processor.clj:241)"
    "query_processor$fn__52297$process_query_and_save_execution_BANG___52306$fn__52309.invoke(query_processor.clj:256)"
    "query_processor$fn__52297$process_query_and_save_execution_BANG___52306.invoke(query_processor.clj:249)"
    "query_processor$fn__52341$process_query_and_save_with_max_results_constraints_BANG___52350$fn__52353.invoke(query_processor.clj:268)"
    "query_processor$fn__52341$process_query_and_save_with_max_results_constraints_BANG___52350.invoke(query_processor.clj:261)"
    "api.dataset$run_query_async$fn__65276.invoke(dataset.clj:69)"
    "query_processor.streaming$streaming_response_STAR_$fn__38459$fn__38460.invoke(streaming.clj:162)"
    "query_processor.streaming$streaming_response_STAR_$fn__38459.invoke(streaming.clj:161)"
    "async.streaming_response$do_f_STAR_.invokeStatic(streaming_response.clj:65)"
    "async.streaming_response$do_f_STAR_.invoke(streaming_response.clj:63)"
    "async.streaming_response$do_f_async$task__26889.invoke(streaming_response.clj:84)"]}
  {:status :failed,
   :class java.sql.SQLException,
   :error "Connections could not be acquired from the underlying database!",
   :stacktrace
   ["com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:118)"
    "com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:692)"
    "com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:140)"
    "--> driver.sqlite$fn__95428.invokeStatic(sqlite.clj:355)"
    "driver.sqlite$fn__95428.invoke(sqlite.clj:353)"
    "driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:499)"
    "driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:487)"
    "driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:496)"
    "driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:487)"
    "driver.sql_jdbc$fn__81915.invokeStatic(sql_jdbc.clj:54)"
    "driver.sql_jdbc$fn__81915.invoke(sql_jdbc.clj:52)"
    "query_processor.context$executef.invokeStatic(context.clj:59)"
    "query_processor.context$executef.invoke(context.clj:48)"
    "query_processor.context.default$default_runf.invokeStatic(default.clj:68)"
    "query_processor.context.default$default_runf.invoke(default.clj:66)"
    "query_processor.context$runf.invokeStatic(context.clj:45)"
    "query_processor.context$runf.invoke(context.clj:39)"
    "query_processor.reducible$pivot.invokeStatic(reducible.clj:34)"
    "query_processor.reducible$pivot.invoke(reducible.clj:31)"
    "query_processor.middleware.mbql_to_native$mbql__GT_native$fn__49659.invoke(mbql_to_native.clj:25)"
    "query_processor.middleware.check_features$check_features$fn__50405.invoke(check_features.clj:42)"
    "query_processor.middleware.limit$limit$fn__48032.invoke(limit.clj:37)"
    "query_processor.middleware.cache$maybe_return_cached_results$fn__50788.invoke(cache.clj:204)"
    "query_processor.middleware.optimize_temporal_filters$optimize_temporal_filters$fn__51821.invoke(optimize_temporal_filters.clj:204)"
    "query_processor.middleware.validate_temporal_bucketing$validate_temporal_bucketing$fn__51865.invoke(validate_temporal_bucketing.clj:50)"
    "query_processor.middleware.auto_parse_filter_values$auto_parse_filter_values$fn__49716.invoke(auto_parse_filter_values.clj:43)"
    "query_processor.middleware.wrap_value_literals$wrap_value_literals$fn__39821.invoke(wrap_value_literals.clj:161)"
    "query_processor.middleware.annotate$add_column_info$fn__44587.invoke(annotate.clj:659)"
    "query_processor.middleware.permissions$check_query_permissions$fn__46329.invoke(permissions.clj:108)"
    "query_processor.middleware.pre_alias_aggregations$pre_alias_aggregations$fn__51010.invoke(pre_alias_aggregations.clj:40)"
    "query_processor.middleware.cumulative_aggregations$handle_cumulative_aggregations$fn__46725.invoke(cumulative_aggregations.clj:60)"
    "query_processor.middleware.visualization_settings$update_viz_settings$fn__46663.invoke(visualization_settings.clj:63)"
    "query_processor.middleware.fix_bad_references$fix_bad_references_middleware$fn__50975.invoke(fix_bad_references.clj:91)"
    "query_processor.middleware.resolve_joined_fields$resolve_joined_fields$fn__47610.invoke(resolve_joined_fields.clj:111)"
    "query_processor.middleware.resolve_joins$resolve_joins$fn__51591.invoke(resolve_joins.clj:176)"
    "query_processor.middleware.add_implicit_joins$add_implicit_joins$fn__51133.invoke(add_implicit_joins.clj:202)"
    "query_processor.middleware.large_int_id$convert_id_to_string$fn__47629.invoke(large_int_id.clj:59)"
    "query_processor.middleware.format_rows$format_rows$fn__51185.invoke(format_rows.clj:74)"
    "query_processor.middleware.add_default_temporal_unit$add_default_temporal_unit$fn__46997.invoke(add_default_temporal_unit.clj:23)"
    "query_processor.middleware.desugar$desugar$fn__46636.invoke(desugar.clj:21)"
    "query_processor.middleware.binning$update_binning_strategy$fn__39550.invoke(binning.clj:229)"
    "query_processor.middleware.resolve_fields$resolve_fields$fn__45971.invoke(resolve_fields.clj:34)"
    "query_processor.middleware.add_dimension_projections$add_remapping$fn__50342.invoke(add_dimension_projections.clj:487)"
    "query_processor.middleware.add_implicit_clauses$add_implicit_clauses$fn__50636.invoke(add_implicit_clauses.clj:164)"
    "query_processor.middleware.upgrade_field_literals$upgrade_field_literals$fn__48017.invoke(upgrade_field_literals.clj:117)"
    "query_processor.middleware.add_source_metadata$add_source_metadata_for_source_queries$fn__47374.invoke(add_source_metadata.clj:125)"
    "query_processor.middleware.reconcile_breakout_and_order_by_bucketing$reconcile_breakout_and_order_by_bucketing$fn__50887.invoke(reconcile_breakout_and_order_by_bucketing.clj:100)"
    "query_processor.middleware.auto_bucket_datetimes$auto_bucket_datetimes$fn__48974.invoke(auto_bucket_datetimes.clj:147)"
    "query_processor.middleware.resolve_source_table$resolve_source_tables$fn__45952.invoke(resolve_source_table.clj:45)"
    "query_processor.middleware.parameters$substitute_parameters$fn__48628.invoke(parameters.clj:111)"
    "query_processor.middleware.resolve_referenced$resolve_referenced_card_resources$fn__46025.invoke(resolve_referenced.clj:79)"
    "query_processor.middleware.expand_macros$expand_macros$fn__52249.invoke(expand_macros.clj:184)"
    "query_processor.middleware.add_timezone_info$add_timezone_info$fn__48407.invoke(add_timezone_info.clj:15)"
    "query_processor.middleware.splice_params_in_response$splice_params_in_response$fn__51200.invoke(splice_params_in_response.clj:32)"
    "query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__50647$fn__50652.invoke(resolve_database_and_driver.clj:35)"
    "driver$do_with_driver.invokeStatic(driver.clj:60)"
    "driver$do_with_driver.invoke(driver.clj:56)"
    "query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__50647.invoke(resolve_database_and_driver.clj:34)"
    "query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__46571.invoke(fetch_source_query.clj:286)"
    "query_processor.middleware.store$initialize_store$fn__46762$fn__46763.invoke(store.clj:11)"
    "query_processor.store$do_with_store.invokeStatic(store.clj:44)"
    "query_processor.store$do_with_store.invoke(store.clj:38)"
    "query_processor.middleware.store$initialize_store$fn__46762.invoke(store.clj:10)"
    "query_processor.middleware.validate$validate_query$fn__50982.invoke(validate.clj:10)"
    "query_processor.middleware.normalize_query$normalize$fn__50989.invoke(normalize_query.clj:22)"
    "query_processor.middleware.add_rows_truncated$add_rows_truncated$fn__48353.invoke(add_rows_truncated.clj:35)"
    "query_processor.middleware.results_metadata$record_and_return_metadata_BANG_$fn__49645.invoke(results_metadata.clj:82)"
    "query_processor.middleware.constraints$add_default_userland_constraints$fn__48371.invoke(constraints.clj:42)"
    "query_processor.middleware.process_userland_query$process_userland_query$fn__50923.invoke(process_userland_query.clj:146)"
    "query_processor.middleware.catch_exceptions$catch_exceptions$fn__51280.invoke(catch_exceptions.clj:169)"
    "query_processor.reducible$async_qp$qp_STAR___43323$thunk__43324.invoke(reducible.clj:103)"
    "query_processor.reducible$async_qp$qp_STAR___43323.invoke(reducible.clj:109)"
    "query_processor.reducible$sync_qp$qp_STAR___43332$fn__43335.invoke(reducible.clj:135)"
    "query_processor.reducible$sync_qp$qp_STAR___43332.invoke(reducible.clj:134)"
    "query_processor$process_userland_query.invokeStatic(query_processor.clj:245)"
    "query_processor$process_userland_query.doInvoke(query_processor.clj:241)"
    "query_processor$fn__52297$process_query_and_save_execution_BANG___52306$fn__52309.invoke(query_processor.clj:256)"
    "query_processor$fn__52297$process_query_and_save_execution_BANG___52306.invoke(query_processor.clj:249)"
    "query_processor$fn__52341$process_query_and_save_with_max_results_constraints_BANG___52350$fn__52353.invoke(query_processor.clj:268)"
    "query_processor$fn__52341$process_query_and_save_with_max_results_constraints_BANG___52350.invoke(query_processor.clj:261)"
    "api.dataset$run_query_async$fn__65276.invoke(dataset.clj:69)"
    "query_processor.streaming$streaming_response_STAR_$fn__38459$fn__38460.invoke(streaming.clj:162)"
    "query_processor.streaming$streaming_response_STAR_$fn__38459.invoke(streaming.clj:161)"
    "async.streaming_response$do_f_STAR_.invokeStatic(streaming_response.clj:65)"
    "async.streaming_response$do_f_STAR_.invoke(streaming_response.clj:63)"
    "async.streaming_response$do_f_async$task__26889.invoke(streaming_response.clj:84)"],
   :state nil}],
�

email + password please :)

what is the metabase default password + email please ?
see #1

is Lepresidente custom image still needed?

Hello,
i have seen now that openresty is included in official npm.
So if i had to integrate NPM with crowdsec, do we still need the custom NPM image lepresidente/nginxproxymanager:latest as reported here https://github.com/crowdsecurity/example-docker-compose/tree/main/npm?

no arm64 crowdsec docker image but only amd64

https://discourse.crowdsec.net/t/crowdsec-docker-amd64-only/313

Container not creating files and folders when started

The container starts up and creates the config.yaml and online_api_credentials.yaml files and then exits with fatal errors. The config file it creates seems to be incomplete. If I create config.yaml from the GitHub example, it then errors out with other missing files and folders. The container is not creating all of the required files and folders it needs on first start to run properly.

config.yaml

api:
  server:
    online_client:
      credentials_path: /etc/crowdsec/online_api_credentials.yaml

Docker-compose

crowdsec:
image: crowdsecurity/crowdsec
restart: always
environment:
- TZ=America/Chicago
- GID="${GID-1000}"
- COLLECTIONS=crowdsecurity/caddy crowdsecurity/linux
volumes:
- "${docker}/crowdsec/config/acquis.yaml:/etc/crowdsec/acquis.yaml"
- "${docker}/caddy/data/access.log:/var/log/access.log"
- "${docker}/crowdsec/db/crowdsec.db:/var/lib/crowdsec/data/crowdsec.db"
- "${docker}/crowdsec/config:/etc/crowdsec/"
networks:
- wg-pia
depends_on:
- 'caddy'

Container logs

Regenerate local agent credentials
time="26-12-2021 10:36:31 AM" level=fatal msg="failed to read config file: open /etc/crowdsec/config.yaml: no such file or directory"
time="26-12-2021 10:36:31 AM" level=fatal msg="failed to read config file: open /etc/crowdsec/config.yaml: no such file or directory"
Check if lapi need to register automatically an agent
Error: open /etc/crowdsec/config.yaml: no such file or directory
Error: open /etc/crowdsec/config.yaml: no such file or directory
time="26-12-2021 10:36:31 AM" level=fatal msg="no configuration paths provided"
registration to online API done
time="26-12-2021 10:36:31 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:31 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:31 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:32 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:32 AM" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:32-06:00" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:32-06:00" level=fatal msg="no configuration paths provided"
Regenerate local agent credentials
time="26-12-2021 10:36:32 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:32 AM" level=fatal msg="no configuration paths provided"
Check if lapi need to register automatically an agent
time="26-12-2021 10:36:32 AM" level=fatal msg="no configuration paths provided"
registration to online API done
time="26-12-2021 10:36:32 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:33 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:33 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:33 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:33 AM" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:33-06:00" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:33-06:00" level=fatal msg="no configuration paths provided"
Regenerate local agent credentials
time="26-12-2021 10:36:33 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:33 AM" level=fatal msg="no configuration paths provided"
Check if lapi need to register automatically an agent
time="26-12-2021 10:36:33 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:33 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:33 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:33 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:33 AM" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:33-06:00" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:33-06:00" level=fatal msg="no configuration paths provided"
Regenerate local agent credentials
time="26-12-2021 10:36:34 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:34 AM" level=fatal msg="no configuration paths provided"
Check if lapi need to register automatically an agent
time="26-12-2021 10:36:34 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:34 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:34 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:34 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:34 AM" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:34-06:00" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:34-06:00" level=fatal msg="no configuration paths provided"
Regenerate local agent credentials
time="26-12-2021 10:36:35 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:35 AM" level=fatal msg="no configuration paths provided"
Check if lapi need to register automatically an agent
time="26-12-2021 10:36:35 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:35 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:35 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:35 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:35 AM" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:35-06:00" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:35-06:00" level=fatal msg="no configuration paths provided"
Regenerate local agent credentials
time="26-12-2021 10:36:37 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:37 AM" level=fatal msg="no configuration paths provided"
Check if lapi need to register automatically an agent
time="26-12-2021 10:36:38 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:38 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:38 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:38 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:38 AM" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:38-06:00" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:38-06:00" level=fatal msg="no configuration paths provided"
Regenerate local agent credentials
time="26-12-2021 10:36:41 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:41 AM" level=fatal msg="no configuration paths provided"
Check if lapi need to register automatically an agent
time="26-12-2021 10:36:41 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:41 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:41 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:41 AM" level=fatal msg="no configuration paths provided"
time="26-12-2021 10:36:41 AM" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:41-06:00" level=fatal msg="no configuration paths provided"
time="2021-12-26T10:36:41-06:00" level=fatal msg="no configuration paths provided"

Enable Dashboard for npm

Hello,

would it be possible to enable the dashboard from crowedsec?

I added

    volumes:
      - /var/run/docker.sock:/var/run/docker.sock:ro

to the docker-compose file from https://github.com/crowdsecurity/example-docker-compose/blob/main/npm/docker-compose.yml

Then I tried to get the dashboard setup:

cscli dashboard setup
? CrowdSec takes no responsibility for the security of your metabase instance. Do you accept these responsibilities ? Yes
? For metabase docker to be able to access SQLite file we need to add a new group called 'crowdsec' to the system, is it ok for you ? Yes
FATA[26-11-2023 15:46:02] unable to find 'groupadd' command, can't continue

Trying to do groupadd crowdsec brings me a little step forward. But I get still an fatal error which I can't solve:

cscli dashboard setup
? CrowdSec takes no responsibility for the security of your metabase instance. Do you accept these responsibilities ? Yes
INFO[26-11-2023 15:46:52] /var/lib/crowdsec/data/metabase.db exists, skip. 
INFO[26-11-2023 15:46:52] Pulling docker image metabase/metabase:v0.46.6.1 
...
INFO[26-11-2023 15:46:53] creating container 'crowdsec-metabase'       
FATA[26-11-2023 15:46:53] container create: failed to create container : Error response from daemon: invalid mount config for type "bind": bind source path does not exist: /var/lib/crowdsec/data

the folder exists /var/lib/crowdsec/data in the docker container.
What can solve this problem?

Question about bouncer in docker compose

I read this line in docker compose. Where is the bouncer added?

example-docker-compose/basic/docker-compose.yml

Line 32 in 574db56

#and later we're going to plug a firewall bouncer to it

Can I create this docker compose as it is in portainer as a stack and then have an nginx reverse proxy protected by crowdsec?

Please excuse my bad English

Not modified yet and crowdsecurity/crowdsec:v1.0.8 keep restarting

Hello,
I'm asking for help with issue. I just clone repository and make command $docker-compose up -d. App has installed and 3 of 4 apps are running healthy. Container crowdsecurity/crowdsec:v1.0.8 keep restarting. Here is log of that container:

$docker ps

CONTAINER ID   IMAGE                           COMMAND                  CREATED          STATUS                          PORTS                                       NAMES
385d106e3f73   crowdsec_dashboard              "/app/run_metabase.sh"   19 minutes ago   Up 19 minutes                   0.0.0.0:3000->3000/tcp, :::3000->3000/tcp   crowdsec_dashboard_1
35e4119c4fb3   crowdsecurity/crowdsec:v1.0.8   "/bin/sh -c '/bin/sh…"   19 minutes ago   Restarting (1) 20 seconds ago                                               crowdsec_crowdsec_1
0240324c7776   nginx:alpine                    "/docker-entrypoint.…"   19 minutes ago   Up 19 minutes                   0.0.0.0:8000->80/tcp, :::8000->80/tcp       crowdsec_reverse-proxy_1
3726be67d541   httpd:alpine                    "httpd-foreground"       19 minutes ago   Up 19 minutes                   80/tcp                                      crowdsec_app_1

$docker logs crowdsec_crowdsec_1

time="10-09-2021 18:09:57" level=info msg="Crowdsec v1.0.8-docker-6f8b6cdb4293bd04169e5ff2c68d54309e735d9c"
time="10-09-2021 18:09:57" level=info msg="Loading prometheus collectors"
time="10-09-2021 18:09:57" level=info msg="Loading CAPI pusher"
time="10-09-2021 18:09:57" level=info msg="start crowdsec api push (interval: 30s)"
time="10-09-2021 18:09:57" level=info msg="start crowdsec api pull (interval: 2h)"
time="10-09-2021 18:09:57" level=warning msg="scenario list is empty, will not pull yet"
time="10-09-2021 18:09:57" level=info msg="start crowdsec api send metrics (interval: 30m)"
time="10-09-2021 18:09:57" level=info msg="Loading grok library /etc/crowdsec//patterns/"
time="10-09-2021 18:09:58" level=info msg="Loading enrich plugins"
time="10-09-2021 18:09:58" level=info msg="Loading parsers 6 stages"
time="10-09-2021 18:09:58" level=error msg="Statics Compilation failed type types.Line has no field Module (1:10)\n | evt.Line.Module\n | .........^." id=young-shadow name=crowdsecurity/syslog-logs stage=s00-raw
time="10-09-2021 18:09:58" level=fatal msg="crowdsec init: Failed to load parsers: failed to load parser config : failed to compile node 'crowdsecurity/syslog-logs' in '/etc/crowdsec/parsers/s00-raw/syslog-logs.yaml' : type types.Line has no field Module (1:10)\n | evt.Line.Module\n | .........^"

Can you please help me to solve it?
Thank you.

dashboard metabase cant build

On Ubuntu VERSION="20.04.2
from a clean server with docker and docker-compose installed
I get errors on dashboard metabase build.

Step 1/2 : FROM metabase/metabase
latest: Pulling from metabase/metabase
a0d0a0d46f8b: Already exists
c4f0e81aa109: Pull complete
b83db16da127: Pull complete
8f729421eec7: Pull complete
51774aa4d406: Pull complete
Digest: sha256:8bb67290f5838de763f124b2663d09453e5dbfae1ef15a080d28f3ca76d3e39e
Status: Downloaded newer image for metabase/metabase:latest
---> b2dcf4f4176c
Step 2/2 : RUN mkdir /data/ && wget https://crowdsec-statics-assets.s3-eu-west-1.amazonaws.com/metabase_sqlite.zip && unzip metabase_sqlite.zip -d /data/
---> Running in 0c9ce4fbc2bd
wget: bad address 'crowdsec-statics-assets.s3-eu-west-1.amazonaws.com'
ERROR: Service 'dashboard' failed to build: The command '/bin/sh -c mkdir /data/ && wget https://crowdsec-statics-assets.s3-eu-west-1.amazonaws.com/metabase_sqlite.zip && unzip metabase_sqlite.zip -d /data/' returned a non-zero code: 1

please add an example for caddy

NPM not starting when using 'lepresidente/nginxproxymanager:latest'

Trying to get the NPM example up and running from here.

When starting the docker compose stack, the NPM container fails with the following

sed: cannot rename /data/crowdsec/sedg2woQQ: Device or resource busy
s6-rc: warning: unable to start service cs-crowdsec-bouncer: command exited 4
/run/s6/basedir/scripts/rc.init: warning: s6-rc failed to properly bring all the services up! Check your logs (in /run/uncaught-logs/current if you have in-container logging) for more information.

The full log file is:

❯ Configuring npm user ...
❯ Configuring npm group ...
❯ Checking paths ...
❯ Setting ownership ...
❯ Dynamic resolvers ...
❯ IPv6 ...
Disabling IPV6 in hosts in: /etc/nginx/conf.d
- /etc/nginx/conf.d/crowdsec_openresty.conf
- /etc/nginx/conf.d/include/assets.conf
- /etc/nginx/conf.d/include/block-exploits.conf
- /etc/nginx/conf.d/include/ip_ranges.conf
- /etc/nginx/conf.d/include/force-ssl.conf
- /etc/nginx/conf.d/include/letsencrypt-acme-challenge.conf
- /etc/nginx/conf.d/include/ssl-ciphers.conf
- /etc/nginx/conf.d/include/proxy.conf
- /etc/nginx/conf.d/include/resolvers.conf
- /etc/nginx/conf.d/production.conf
- /etc/nginx/conf.d/default.conf
Disabling IPV6 in hosts in: /data/nginx
- /data/nginx/proxy_host/1.conf
- /data/nginx/proxy_host/4.conf
- /data/nginx/proxy_host/2.conf
- /data/nginx/proxy_host/3.conf
❯ Docker secrets ...

-------------------------------------
 _   _ ____  __  __
| \ | |  _ \|  \/  |
|  \| | |_) | |\/| |
| |\  |  __/| |  | |
|_| \_|_|   |_|  |_|
-------------------------------------
User:  npm PUID:0 ID:0 GROUP:0
Group: npm PGID:0 ID:0
-------------------------------------

❯ Starting backend ...
Deploy Crowdsec Openresty Bouncer..
Patch crowdsec-openresty-bouncer.conf ..
[12/30/2023] [4:10:42 PM] [Global   ] › ℹ  info      Using Sqlite: /data/database.sqlite
sed: cannot rename /data/crowdsec/sed68C3rj: Device or resource busy
s6-rc: warning: unable to start service cs-crowdsec-bouncer: command exited 4
/run/s6/basedir/scripts/rc.init: warning: s6-rc failed to properly bring all the services up! Check your logs (in /run/uncaught-logs/current if you have in-container logging) for more information.
[12/30/2023] [4:10:43 PM] [Migrate  ] › ℹ  info      Current database version: none
[12/30/2023] [4:10:49 PM] [Setup    ] › ℹ  info      Added Certbot plugins certbot-dns-cloudflare==$(certbot --version | grep -Eo '[0-9](\.[0-9]+)+') cloudflare
[12/30/2023] [4:10:49 PM] [Setup    ] › ℹ  info      Logrotate Timer initialized
[12/30/2023] [4:10:49 PM] [Setup    ] › ℹ  info      Logrotate completed.
[12/30/2023] [4:10:49 PM] [IP Ranges] › ℹ  info      Fetching IP Ranges from online services...
[12/30/2023] [4:10:49 PM] [IP Ranges] › ℹ  info      Fetching https://ip-ranges.amazonaws.com/ip-ranges.json
[12/30/2023] [4:10:49 PM] [IP Ranges] › ℹ  info      Fetching https://www.cloudflare.com/ips-v4
[12/30/2023] [4:10:49 PM] [IP Ranges] › ℹ  info      Fetching https://www.cloudflare.com/ips-v6
[12/30/2023] [4:10:50 PM] [SSL      ] › ℹ  info      Let's Encrypt Renewal Timer initialized
[12/30/2023] [4:10:50 PM] [SSL      ] › ℹ  info      Renewing SSL certs close to expiry...
[12/30/2023] [4:10:50 PM] [IP Ranges] › ℹ  info      IP Ranges Renewal Timer initialized
[12/30/2023] [4:10:50 PM] [Global   ] › ℹ  info      Backend PID 156 listening on port 3000 ...
[12/30/2023] [4:10:52 PM] [Nginx    ] › ℹ  info      Reloading Nginx
[12/30/2023] [4:10:52 PM] [SSL      ] › ✖  error     Error: Command failed: /usr/sbin/nginx -s reload 
nginx: [error] invalid PID number "" in "/run/nginx/nginx.pid"

    at ChildProcess.exithandler (node:child_process:402:12)
    at ChildProcess.emit (node:events:513:28)
    at maybeClose (node:internal/child_process:1100:16)
    at Process.ChildProcess._handle.onexit (node:internal/child_process:304:5)

the docker-compose.yaml is as follows

version: '3'

services:
  app:
    #image: 'jc21/nginx-proxy-manager:latest'
    image: 'lepresidente/nginxproxymanager:latest'

    restart: unless-stopped
    networks:
      crowdsec:
      nginx:
    ports:
      # These ports are in format :
      - '80:80' # Public HTTP Port
      - '443:443' # Public HTTPS Port
      - '81:81' # Admin Web Port
    environment:
      # Uncomment this if IPv6 is not enabled on your host
      DISABLE_IPV6: 'true'
    volumes:
      - /swarmvol/npm/data:/data
      - /swarmvol/crowdsec/crowdsec-openresty-bouncer.conf:/data/crowdsec/crowdsec-openresty-bouncer.conf
      - /swarmvol/npm/letsencrypt:/etc/letsencrypt
    security_opt:
      - no-new-privileges=true

  crowdsec:
    image: docker.io/crowdsecurity/crowdsec:latest
    container_name: crowdsec
    environment:
      - COLLECTIONS=crowdsecurity/nginx-proxy-manager
    volumes:
      - /swarmvol/crowdsec/crowdsec-db:/var/lib/crowdsec/data/
      - /swarmvol/crowdsec/config:/etc/crowdsec/
      - /swarmvol/npm/data/logs/:/var/log/npm:ro
      - /swarmvol/crowdsec/acquis.yaml:/etc/crowdsec/acquis.yaml
    networks:
      crowdsec:
    restart: unless-stopped
    security_opt:
      - no-new-privileges=true
        
networks:
    nginx:
      external: true
    crowdsec:
      external: true

Note im using a 3 node docker swarm cluster with /swarmvol being a truenas NFS mount to all hosts.

If it remove the following volume mount, the container starts as expected, but crowdsec is not enabled.

      - /swarmvol/crowdsec/crowdsec-openresty-bouncer.conf:/data/crowdsec/crowdsec-openresty-bouncer.conf

So it seems to me that something is the matter with this config file, I have tied multiple changes within crowdsec-openresty-bouncer.conf, including leaving it just as ENABLED=true, but each time the same error as above occurs.

Any idea what im doing wrong here?

Docker version

Client: Docker Engine - Community
 Version:           24.0.7
 API version:       1.43
 Go version:        go1.20.10
 Git commit:        afdd53b
 Built:             Thu Oct 26 09:08:01 2023
 OS/Arch:           linux/amd64
 Context:           default

Server: Docker Engine - Community
 Engine:
  Version:          24.0.7
  API version:      1.43 (minimum version 1.12)
  Go version:       go1.20.10
  Git commit:       311b9ff
  Built:            Thu Oct 26 09:08:01 2023
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.6.25
  GitCommit:        d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f
 runc:
  Version:          1.1.10
  GitCommit:        v1.1.10-0-g18a0cb0
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

Ubuntu 20.04.6 LTS

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.