daniil-berg/stocksymbolscraper
2
1
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
7 Commits 1 Branch 0 Tags 72 KiB
Python 99.4%
Shell 0.6%
59530b5913
Go to file
Daniil Fajnberg 59530b5913 added pip requirements and readme text
2021-11-09 19:09:24 +01:00
requirements added pip requirements and readme text 2021-11-09 19:09:24 +01:00
src/stock-symbol-scraper first working draft for scraping all stock symbols (and supplementary data) 2021-11-09 17:03:20 +01:00
.gitignore initial commit 2021-11-07 15:23:15 +01:00
LICENSE python packaging boilerplate 2021-11-07 15:56:36 +01:00
pyproject.toml python packaging boilerplate 2021-11-07 15:56:36 +01:00
README.md added pip requirements and readme text 2021-11-09 19:09:24 +01:00
setup.cfg python packaging boilerplate 2021-11-07 15:56:36 +01:00

README.md

Stock Symbol Scraper

Scrapes the entire list of stocks off of MarketWatch.com, which includes company name, stock symbol, country, exchange, and sector (if available).

NOTE: No prices or financials of any kind are collected.

At this time the scraper performs this task purely sequentially. Asynchronous HTTP requests to drastically speed up the process will be implemented soon.

This is not intended to be run continuously since the data gathered this way will rarely change.

Dependencies

Should run on most Linux/Windows systems. Tested on Arch and Windows 10.

Building

Clone this repo, install build via pip, then run pip -m build from the repository's root directory. This should produce a dist/ subdirectory with a wheel (build) and archive (source) distribution. The resulting whl-file can be installed via pip install path/dist/***.whl.

Running

...