Random CRM data generator by Embulk Input plugin

WARNING: THIS IS VERY ALPHA VERSION. API OR CONFIGURATION COULD CHANGE.

Random CRM data generator for Embulk. Expected to used to test or benchmark.

NOTE

This plugin hasn't released rubygemns yet because this is alpha version.
This plugin currently uses Faker so this plugin supports i18n partially.

Overview

Plugin type: input
Resume supported: no
Cleanup supported: no
Guess supported: no

Configuration

locale: description (string, default: "en" acceptable locale: stympy/faker - locales.)
rows: number of inserting rows (long, default: 10)
threads: number of threads (long, default: 1)
columns: description (array, required)
- type: boolean
  - return random boolean value
  - true_rate: rate of return true value (double, default: 0.5)
- type: double
  - return random double value. (config with dummy option, specific formatted double value such as latitude and longitude)
  - dummy: latitude or longitude (string)
  - before_point: place before the decimal point (long, default: 4)
  - after_point: place after the decimal point (long, default: 2)
- type: long
  - return random long value
  - from: minimum of return value (long, default: 0)
  - to: maximum of return value (long, default: 1000000)
- type: string
  - return random string value (config with dummy option, specific formatted string value such as phone number, email etc.)
  - default: default return string value without dummy option (string, default: This is dummy data.)
  - dummy: phone number, postal code etc. for more detail see List of string dummy options below.
- type: timestamp
  - return random timestamp value
  - from: start timestamp of return value (date, default: 1970-01-01)
  - to: end timestamp of return value (date, default: Date.today)

List of supported string dummy options

city: city name
country: country name
email: email address (note: currently, email domain for safe)
full_name: first name and last name
list: config with array value label option, pick value randomly from label array.
phone_number: phone number
postal_code: postal code
state: state name
street: street name
url: URL
uuid: uuid v4

Example

This is a example of config.yml.

in:
  type: random_crm_dummy
  columns:
    - {name: AccountSource,          type: string,    dummy: list, label: ['Ad', 'Data.com']}
    - {name: AnnualRevenue,          type: long,      from: 0, to: 10000000000}
    - {name: BillingState,           type: string,    dummy: state}
    - {name: Description,            type: string,    default_string: 'This is default string.'}
    - {name: Industry,               type: string,    dummy: list, label: ['manufacture', 'financial']}
    - {name: IsDeleted,              type: boolean,   true_ratio: 0.9}
    - {name: DeleteDatetime,         type: timestamp, from: '2017-01-01', to: '2017-12-31'}
out:
  type: stdout

and gets

Ad,7206991348,Hawaii,This is default string.,financial,true,2017-09-30 15:00:00.000000 +0000
Ad,9434694520,Colorado,This is default string.,manufacture,true,2017-01-23 15:00:00.000000 +0000
Ad,9303439532,Oregon,This is default string.,financial,true,2017-06-01 15:00:00.000000 +0000
Data.com,5443621215,South Dakota,This is default string.,manufacture,true,2017-06-19 15:00:00.000000 +0000
Data.com,7653675596,Kansas,This is default string.,financial,true,2017-10-08 15:00:00.000000 +0000
Ad,3533962671,Oregon,This is default string.,financial,true,2017-02-01 15:00:00.000000 +0000
Data.com,6641817856,California,This is default string.,financial,true,2017-04-01 15:00:00.000000 +0000
Data.com,4558029927,Colorado,This is default string.,manufacture,true,2017-12-08 15:00:00.000000 +0000
Data.com,9341647144,Arizona,This is default string.,financial,true,2017-10-12 15:00:00.000000 +0000
Ad,3732589682,New Jersey,This is default string.,financial,true,2017-08-01 15:00:00.000000 +0000

For more example, please see examples folder.

Installation

This plugin doesn't release rubygems. So clone and build and install step required.

# clone
$ git clone https://github.com/noissefnoc/embulk-input-random_crm_dummy.git

# build
$ cd embulk-input-random_crm_dummy
$ bundle install   # install one using rbenv & rbenv-build
$ bundle exec rake # build gem

# install
$ embulk gem install pkg/embulk-input-random_crm_dummy-0.1.0.gem

License

This code is free to use under the terms of MIT licence.

License

noissefnoc/embulk-input-random_crm_dummy

ErrorLooks like something went wrong!

About

Topics

Resources

License

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Uh oh!

Languages

Error
Looks like something went wrong!

Packages