website sync feature (#4429)

* perf: introduce BullMQ for website sync (#4403)

* perf: introduce BullMQ for website sync

* feat: new redis module

* fix: remove graceful shutdown

* perf: improve UI in dataset detail

- Updated the "change" icon SVG file.
- Modified i18n strings.
- Added new i18n string "immediate_sync".
- Improved UI in dataset detail page, including button icons and
background colors.

* refactor: Add chunkSettings to DatasetSchema

* perf: website sync ux

* env template

* fix: clean up website dataset when updating chunk settings (#4420)

* perf: check setting updated

* perf: worker currency

* feat: init script for website sync refactor (#4425)

* website feature doc

---------

Co-authored-by: a.e. <49438478+I-Info@users.noreply.github.com>

packages/web/i18n/en/common.json

@@ -512,7 +512,7 @@
   "core.dataset.Query extension intro": "Enabling the question optimization function can improve the accuracy of Dataset searches during continuous conversations. After enabling this function, when performing Dataset searches, the AI will complete the missing information of the question based on the conversation history.",
   "core.dataset.Quote Length": "Quote Content Length",
   "core.dataset.Read Dataset": "View Dataset Details",
-  "core.dataset.Set Website Config": "Start Configuring Website Information",
+  "core.dataset.Set Website Config": "Start Configuring",
   "core.dataset.Start export": "Export Started",
   "core.dataset.Table collection": "Table Dataset",
   "core.dataset.Text collection": "Text Dataset",
@@ -528,7 +528,6 @@
   "core.dataset.collection.Website Empty Tip": "No Website Associated Yet",
   "core.dataset.collection.Website Link": "Website Address",
   "core.dataset.collection.id": "Collection ID",
-  "core.dataset.collection.metadata.Chunk Size": "Chunk Size",
   "core.dataset.collection.metadata.Createtime": "Creation Time",
   "core.dataset.collection.metadata.Raw text length": "Raw Text Length",
   "core.dataset.collection.metadata.Updatetime": "Update Time",
@@ -630,6 +629,7 @@
   "core.dataset.search.search mode": "Search Method",
   "core.dataset.status.active": "Ready",
   "core.dataset.status.syncing": "Syncing",
+  "core.dataset.status.waiting": "Waiting",
   "core.dataset.test.Batch test": "Batch Test",
   "core.dataset.test.Batch test Placeholder": "Select a CSV File",
   "core.dataset.test.Search Test": "Search Test",