- Fixed bug in scraping RS website when a part search results in a list of matches instead of a single product page.
- Fixed crash caused by uninitialized array in Digikey webscraping module.
- Place any available scraped part info into spreadsheet even if part is not available from a distributor.
- Removed unused imports from distributor modules.
- Surround worksheet name with quotes in case it contains spreadsheet operators.
- Fixed extraction of product links from Farnell product tables.
- Added options for including or excluding distributors.
- Updated web scrapers for various distributors.
- Added more debugging/logger statements.
- Updated some of the package requirements.
- Giacinto Luigi Cerone added support for distributors Farnell and RS.
- Manufacturer's part number field can now be labeled as 'manf#', 'mpn', 'pn', '#', etc. (See documentation.)
- Manufacturer field can now be labeled as 'manf' or 'manufacturer'.
- Distributor part number fields can now be labeled as 'digikey#', 'digikeypn', digikey_pn', 'digikey-pn', etc.
- KiCost no longer fails if the <libparts>...</libparts> section is missing from the XML file.
- Documentation moved to Github Pages.
- Fixed scraping of Digi-Key pages to correctly detect reeled parts and scrape alternate packaging options.
- Fixed scraping of Digi-Key pages to correctly extract available quantity of parts.
- Progress bar is explicitly deleted to prevent an error from occurring when the program terminates.
- Contents of "Desc" field in component/library were being ignored when generating spreadsheet.
- Fixed part scraping from Newark website.
- Added progress bar.
- Added quiet option to suppress warning messages.
- 'manf#' and 'manf' fields are now both propagated to similar parts.
- Extra part data can now be shown in the global data section of the spreadsheet
by using the new
--fields
command-line option. This commit implements issue #8.
- Parts with valid Digi-Key web pages were not appearing in the spreadsheet because they had strange quantity listings (e.g., input fields or 'call for quantities'. This commit fixes #36.
- Prices of $0.00 were appearing in the spreadsheet for parts that were listed but not stocked. Parts having no pricing list no longer list a price in the sheet.
- Parts with short manf. numbers (e.g. 5010) were not found correctly in the distributor websites. The manufacturer name was added to the search string to increase the probability of the search finding the correct part.
- Local parts weren't showing up in spreadsheet because of previous fix to omit parts that had no quantity field (non-stocked; not even 0). Fixed.
- Made change to adapt to change in Digi-Key's part quantity field of their webpages.
- Omit parts from the spreadsheet that are listed but not stocked at a distributor.
- Made changes to adapt to changes in Digi-Key's webpage format.
- Added
--variant
command-line option for costing different variants of a single schematic. - Added
--num_processes
command-line option for setting the number of parallel processes used to scrape part data from the distributor web sites. - Added
--ignore_fields
command-line option for ignoring benign fields that might prevent identical parts from being grouped together.
- Fixed exception caused when indexing with 'manf#' on components that didn't have that field defined.
- Replaced custom debug_print() with logging module.
- When scraping a Digi-Key product list page, use both the manfufacturer's AND Digi-Key's number to select the closest match to the part number.
- 'kicost:' can be prepended to schematic field labels to distinguish them from other app fields.
- Custom prices and documentation links can now be added to parts in the schematic.
- Web-scraping for part data is sped up using parallel processes.
- Following the IP address mouser with redirect you to the nearest locale match, so the price will be in Euro if you are in Europe and the price decimal can be a comma.
- Changed BOARD_COST field to UNIT_COST.
- Changed formatting of UNIT_COST field to make use monetary units.
- Changed format of debug messages.
- Pushed lxml requirement back to 3.3.3 so linux mint would have fewer problems trying to install.
- Fixed exception caused by Digi-Key part with 'call' as an entry in a part's price list.
- Fixed extraction of part quantities in Mouser web pages.
- Added randomly-selected user-agent strings so sites might be less likely to block scraping.
- Added ghost.py code for getting around Javascript challenge pages (currently inactive).
- Added missing requirements for future and lxml packages.
- KiCost now runs under both Python 2.7.6 and 3.4.
- Mouser changed their HTML page format, so I changed their web scraper.
- Corrected entrypoint in __main__.py.
- Added conditional formatting to indicate which distributor had the best price for a particular part.
- Fixed calc of min unit price so it wouldn't be affected if part rows were sorted.
- Added global part columns that show minimum unit and extended prices for all parts across all distributors.
- Refactoring.
- To reduce the effort in adding manufacturer's part numbers to a schematic, one will now be assigned to a part if:
- It doesn't have one.
- It is identical to another part or parts which do have a manf. part number.
- There are no other identical parts with a different manf. part number than the ones in item #2.
- Fixed delimiter for Mouser online order cut-and-paste.
- First release on PyPI.