-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Openalex sources #8
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi @muzgash
I will not run this because I don't have space to save the openalex dump.
I leave some comments
Kahi_openalex_sources/README.md
Outdated
<center><img src="https://raw.githubusercontent.com/colav/colav.github.io/master/img/Logo.png"/></center> | ||
|
||
# Kahi OpenAlex sources plugin | ||
Kahi will use this plugin to insert or update the journal information from DOAJ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
do you mean from openalex?
Kahi_openalex_sources/README.md
Outdated
log_database: kahi_log | ||
log_collection: log | ||
workflow: | ||
doaj_sources: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is this required?
Kahi_openalex_sources/README.md
Outdated
database_url: localhost:27017 | ||
database_name: doaj | ||
collection_name: stage | ||
openalex_sources: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
wrong indentation
Kahi_openalex_sources/setup.py
Outdated
# Dependent packages (distributions) | ||
# put you packages here | ||
install_requires=[ | ||
'kahi' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think pymongo is required
I found something else running the plugin I and getting kahi_run --workflow flow.yml --verbose 5
OrderedDict([('config', OrderedDict([('database_url', 'localhost:27017'), ('database_name', 'kahi'), ('log_database', 'kahi_log'), ('log_collection', 'log')])), ('workflow', OrderedDict([('openalex_sources', OrderedDict([('database_url', 'localhost:27017'), ('database_name', 'openalex_kahi'), ('collection_name', 'venues')]))]))])
Log retrieved from database
[{'_id': 'scienti_sources', 'time': 1691009182, 'status': 1, 'message': "time data '2008-11-23 12:19:44' does not match format '%a, %d %b %Y %H:%M:%S %Z'", 'time_elapsed': 0}]
Loading plugin: kahi_openalex_sources
Running plugin: kahi_openalex_sources take a look in this part Log retrieved from database
[{'_id': 'scienti_sources' I am in the plugin openalex_sources and it is retrieving the log for scineti. |
No description provided.