Prices Crawler - Content Base
The main goal of this project is to provide a framework to search, store and retrieve product data, enabling price
comparison and analysis.
Open API URL: http://localhost:8080/swagger-ui.html
# |
name |
Value |
1 |
Java |
17 |
2 |
Maven |
3.8.6 |
- There is a known issue with the
DATABASE_NAME environment variable not functioning properly after the Spring Boot 3.1 update.
- Solution: To resolve this issue, it is recommended to include the database name in the DATABASE_URL.
# |
Name |
Type |
Description |
Default |
1 |
ACTIVE_PROFILE |
String |
Spring profile name |
- |
2 |
PORT |
int |
Service port |
8080 |
3 |
DATABASE_URL |
String |
Database path url |
- |
4 |
DATABASE_NAME |
String |
Database schema name |
- |
Spring Environment Properties
# |
Name |
Type |
Description |
Default |
1 |
spring.data.mongodb.uri |
String |
Mongodb URI |
- |
2 |
spring.data.mongodb.database |
String |
Mongodb database name |
- |
3 |
prices.crawler.cache.enabled |
Boolean |
Cache service |
true |
4 |
prices.crawler.history.enabled |
Boolean |
Prices history service |
true |
5 |
prices.crawler.product-incident.enabled |
Boolean |
Product incident check |
true |
6 |
prices.crawler.controller.catalog.enabled |
Boolean |
Catalog controller |
false |
7 |
prices.crawler.controller.product.list.enabled |
Boolean |
Product controller |
false |
8 |
prices.crawler.controller.product.search.enabled |
Boolean |
Product controller |
false |
9 |
prices.crawler.controller.product.parser.enabled |
Boolean |
Product controller |
false |
10 |
prices.crawler.controller.product.history.enabled |
Boolean |
Product controller |
false |
11 |
prices.crawler.background.service.cron |
String |
Cron string |
0 0 0 * * * |
12 |
prices.crawler.product.data.hintsEnabled |
String |
Product hints enabled |
true |
13 |
prices.crawler.product.data.searchTermsEnabled |
String |
Product search terms enabled |
true |
- To ensure maximum performance create the following indexes: