Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Openalex sources #8

Merged
merged 4 commits into from
Aug 8, 2023
Merged

Openalex sources #8

merged 4 commits into from
Aug 8, 2023

Conversation

muzgash
Copy link
Contributor

@muzgash muzgash commented Aug 1, 2023

No description provided.

Copy link
Contributor

@omazapa omazapa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @muzgash
I will not run this because I don't have space to save the openalex dump.

I leave some comments

<center><img src="https://raw.githubusercontent.com/colav/colav.github.io/master/img/Logo.png"/></center>

# Kahi OpenAlex sources plugin
Kahi will use this plugin to insert or update the journal information from DOAJ
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do you mean from openalex?

log_database: kahi_log
log_collection: log
workflow:
doaj_sources:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this required?

database_url: localhost:27017
database_name: doaj
collection_name: stage
openalex_sources:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

wrong indentation

# Dependent packages (distributions)
# put you packages here
install_requires=[
'kahi'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think pymongo is required

@omazapa
Copy link
Contributor

omazapa commented Aug 2, 2023

I found something else

running the plugin I and getting

kahi_run --workflow flow.yml  --verbose 5
OrderedDict([('config', OrderedDict([('database_url', 'localhost:27017'), ('database_name', 'kahi'), ('log_database', 'kahi_log'), ('log_collection', 'log')])), ('workflow', OrderedDict([('openalex_sources', OrderedDict([('database_url', 'localhost:27017'), ('database_name', 'openalex_kahi'), ('collection_name', 'venues')]))]))])
Log retrieved from database
[{'_id': 'scienti_sources', 'time': 1691009182, 'status': 1, 'message': "time data '2008-11-23 12:19:44' does not match format '%a, %d %b %Y %H:%M:%S %Z'", 'time_elapsed': 0}]
Loading plugin: kahi_openalex_sources
Running plugin: kahi_openalex_sources

take a look in this part

Log retrieved from database
[{'_id': 'scienti_sources'

I am in the plugin openalex_sources and it is retrieving the log for scineti.

@muzgash muzgash merged commit f0cc823 into main Aug 8, 2023
0 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants