Skip to content

Commit

Permalink
Add host cmd argument in quick start guide
Browse files Browse the repository at this point in the history
  • Loading branch information
sitaowang1998 committed Jan 13, 2025
1 parent f299de3 commit f51a1df
Showing 1 changed file with 9 additions and 3 deletions.
12 changes: 9 additions & 3 deletions docs/quick-start.md
Original file line number Diff line number Diff line change
Expand Up @@ -146,13 +146,15 @@ To start the scheduler, run:
build/spider/src/spider/spider_scheduler \
--storage_url \
"jdbc:mariadb://localhost:3306/spider-storage?user=spider&password=password" \
--host "127.0.0.1" \
--port 6000
```

NOTE:

* If you used a different set of arguments to set up the storage backend, ensure you update the
`storage_url` argument in the command.
* In production, change the host to the real IP address of the machine running the scheduler.
* If the scheduler fails to bind to port `6000`, change the port in the command and try again.

## Setting up a worker
Expand All @@ -169,13 +171,17 @@ To start a worker, run:
build/spider/src/spider/spider_worker \
--storage_url \
"jdbc:mariadb://localhost:3306/spider-storage?user=spider&password=password" \
--port 6000
--host "127.0.0.1" \
--libs "build/libtasks.so"
```

NOTE:

If you used a different set of arguments to set up the storage backend, ensure you update the
`storage_url` argument in the command.
* If you used a different set of arguments to set up the storage backend, ensure you update the
`storage_url` argument in the command.
* In production, change the host to the real IP address of the machine running the worker.
* You can specify multiple task libraries to load. The task libraries must be built with linkage
to the Spider client library.

> [!TIP]
> You can start multiple workers to increase the number of concurrent tasks that can be run on the
Expand Down

0 comments on commit f51a1df

Please sign in to comment.