|
1 |
| -# id-jobs: Your One-Stop Shop for Indonesian Job Market Data |
| 1 | +# id-jobs: Your One-Stop Shop for Indonesian Job Market Data (Now with 50% Less Frustration!) |
2 | 2 |
|
3 | 3 | [](https://github.com/ceroberoz/id-jobs/actions/workflows/scrape.yml)
|
4 | 4 | [](https://www.gnu.org/licenses/gpl-3.0)
|
5 |
| -[](https://www.python.org/downloads/) |
| 5 | +[](https://www.python.org/downloads/) |
6 | 6 | 
|
7 |
| - |
8 | 7 | 
|
9 | 8 | 
|
10 | 9 |
|
11 | 10 | 📊 **View Job Data:** [https://s.id/id-jobs-v2](https://s.id/id-jobs-v2)
|
12 | 11 |
|
13 |
| -id-jobs brings together job listings from various Indonesian job boards and company websites into one easy-to-access Google Sheet. We use open-source tools like Scrapy, Playwright, Pandas, and GitHub Actions to collect and organize this data daily. |
| 12 | +id-jobs: Because searching for a job shouldn't feel like finding a needle in a haystack... made of more needles. |
14 | 13 |
|
15 |
| -🇮🇩 **Important:** id-jobs is specifically designed for the Indonesian job market. |
| 14 | +🇮🇩 **Important:** id-jobs is specifically designed for the Indonesian job market. If you're looking for jobs in Antarctica, you're in the wrong place (but we admire your adventurous spirit!). |
16 | 15 |
|
17 | 16 | ## Why id-jobs?
|
18 | 17 |
|
19 |
| -Finding the perfect job in Indonesia can be overwhelming. Jumping between multiple websites, tracking different listings, and comparing salaries is time-consuming. id-jobs simplifies this process by gathering job information from various Indonesian sources into one place. |
| 18 | +Ever felt like finding a job in Indonesia is like trying to herd cats while juggling flaming torches? Say no more! id-jobs gathers job listings faster than you can say "Aku butuh pekerjaan!" |
20 | 19 |
|
21 | 20 | ## How it Works
|
22 | 21 |
|
23 |
| -Think of id-jobs as your personal job-hunting assistant for the Indonesian market. It visits local job websites, collects relevant information, and organizes it all in one spreadsheet. This process, called web scraping, is done respectfully and in line with each website's terms of service. |
| 22 | +Picture id-jobs as your personal job-hunting ninja. It stealthily visits Indonesian job websites, grabs the goods, and presents it all in one tidy spreadsheet. No black outfit or throwing stars required! |
24 | 23 |
|
25 |
| -We currently collect data from Indonesian job boards and company sites, including: |
26 |
| -- Jobstreet Indonesia |
27 |
| -- Glints Indonesia |
28 |
| -- Kalibrr |
29 |
| -- And more local sources! |
| 24 | +We currently infiltrate... err, collect data from: |
| 25 | +- Jobstreet Indonesia (not to be confused with Sesame Street) |
| 26 | +- Glints Indonesia (shinier than regular Indonesia) |
| 27 | +- Kalibrr (fun to say, even more fun to find jobs on) |
| 28 | +- And more local sources than you can shake a stick at! |
30 | 29 |
|
31 | 30 | ## Making Sense of the Data
|
32 | 31 |
|
33 |
| -With all this Indonesian job data in one place, you can: |
34 |
| -- Spot trends in job titles, salaries, or locations across Indonesia |
35 |
| -- Create visual charts and graphs using tools like Google Looker Studio or Tableau |
36 |
| -- Use spreadsheet functions to filter and analyze the Indonesian job market |
| 32 | +With all this Indonesian job data at your fingertips, you can: |
| 33 | +- Spot trends faster than a teenager spots a new TikTok dance |
| 34 | +- Create charts so beautiful, they'll make Excel jealous |
| 35 | +- Use spreadsheet functions to analyze the job market (Warning: May cause unexpected bouts of "I love data!") |
37 | 36 |
|
38 |
| -## Get Involved (for Beginners) |
| 37 | +## Get Involved (for Beginners and Brave Souls) |
39 | 38 |
|
40 |
| -Want to run the scrapers yourself or contribute to the project? Here's how to get started: |
| 39 | +Want to join our merry band of scraper-wielding job-data enthusiasts? Here's how: |
41 | 40 |
|
42 | 41 | 1. **Copy the project to your computer:**
|
43 |
| - - Go to the [GitHub page](https://github.com/ceroberoz/id-jobs) |
44 |
| - - Click the green "Code" button and copy the URL |
45 |
| - - Open your computer's terminal |
46 |
| - - Type `git clone [paste URL here]` and press Enter |
| 42 | + - It's like adopting a digital pet, but less needy |
47 | 43 |
|
48 | 44 | 2. **Set up your workspace:**
|
49 |
| - - Install Python from python.org |
50 |
| - - In the terminal, go to the project folder |
51 |
| - - Create a virtual environment: `python -m venv venv` |
52 |
| - - Activate it: |
53 |
| - - Windows: `venv\Scripts\activate` |
54 |
| - - Mac/Linux: `source venv/bin/activate` |
| 45 | + - Create a virtual environment (It's like a fort for your code!) |
55 | 46 |
|
56 | 47 | 3. **Install necessary tools:**
|
57 |
| - - Run: `pip install -r requirements.txt` |
58 |
| - - Then: `playwright install` |
| 48 | + - `pip install -r requirements.txt` (Collect them all!) |
59 | 49 |
|
60 | 50 | 4. **Run a scraper:**
|
61 |
| - - To see results in the terminal: |
62 |
| - `scrapy crawl [scraper name]` (e.g., `scrapy crawl jobstreet`) |
63 |
| - - To save results to a file: |
64 |
| - `scrapy crawl [scraper name] -o filename.csv -t csv` |
| 51 | + - Watch in awe as job data flows like poetry... or at least structured data |
65 | 52 |
|
66 | 53 | ## Work in Progress
|
67 | 54 |
|
68 |
| -Some job sources might be temporarily unavailable as websites change. We're continuously updating our scrapers to keep the data flowing. |
| 55 | +Some job sources might be playing hard to get. Don't worry, our code cupids are on the case! |
69 | 56 |
|
70 | 57 | ## License
|
71 | 58 |
|
72 |
| -id-jobs is open source under the GNU General Public License v3 (GPL-3.0). You're free to use, modify, and share the code, as long as you keep it open source too. |
| 59 | +id-jobs is open source under the GPL-3.0 license. Use it, tweak it, share it – just keep it open source. It's like a potluck, but for code! |
73 | 60 |
|
74 |
| -Remember: Always respect website terms of service when scraping! |
| 61 | +Remember: Always scrape responsibly. No website feelings were harmed in the making of this project! |
0 commit comments