You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Parsing profiles descriptions (Reddit and Twitter) and updating it
Filters: deleted, suspended, dates
Collections containing deleted profiles are marked in blue
Marked collection context elements
Find profile in the main window from the info form
New hotkeys in the info form: up, down, find, enter
New hotkey in the main window: enter
New list refill algo
Added copying user pictures from all channels
Changed view modes
Changed comparer and ToString of UserDataBase
New parameter added to channels stats (my users)
Added view mode "details"
Fixed twitter files overriding
Fixed full parsing of reddit posts
Fixed Insta timers and minors
Fixed library fatal
Removed UserDataBind comparer override
Added GetUserMediaOnly for reddit users from channels
Added Reddit availability check with DownDetector
Added PLUGINS
Copy file name to clipboardexpand all lines: Changelog.md
+40
Original file line number
Diff line number
Diff line change
@@ -1,3 +1,43 @@
1
+
# 3.0.0.0
2
+
3
+
**Attention! This version of the program makes changes user data file (Users.xml). Once you start using this version, you will not be able to use previous versions of the program. Therefore, it is highly recommended to archive the program settings folder and archive the users' data files (you can use the [```ArchiveSCrawlerUsersDataFiles.bat```](Tools/ArchiveSCrawlerUsersDataFiles.bat) tool to archive the data files of all users).**
4
+
5
+
- Added
6
+
-**PLUGINS SUPPORT**
7
+
-**Gfycat** site support
8
+
- Description of Twitter and Reddit user profiles
9
+
- Filter users by profile status "Suspended"
10
+
- Filter users by profile status "Deleted"
11
+
- Filter profiles that haven't downloaded new data since specific date
12
+
- Collections that contain non-existent profiles will be marked in blue
13
+
- Ability to find and activate a user in the main window from the Info form
14
+
- Ability to copy user images from all channels you have when adding a user from a channel
15
+
- Reddit default option "Get user media only" if now also used when creating new users from channels
16
+
- Ability to update user description every time
17
+
-```Enter``` hotkey in the download info form to open the user's folder
18
+
-```Enter``` hotkey in the main window to open the user's folder
19
+
- Channel statistics are supplemented by "existing users"
20
+
-```Up``` and ```Down``` navigation buttons in the Info form
21
+
-```Find``` button on the Info form to find the user in the main window
22
+
- "Details" view mode
23
+
- Fast loading of profiles in the main window. **Be careful with this setting. Fast loading leads to the highest CPU usage.**
24
+
- Reddit availability check with DownDetector
25
+
- Ability to [open folders with a specific program](https://github.com/AAndyProgram/SCrawler/wiki/Settings#folder-command)
26
+
- (Request #16) Ability to remove a user from the collection without deletion
- Reddit saved posts downloader downloads all posts every time
35
+
- Minor bug that caused Instagram tasks timers to run longer
36
+
- A library error that in some cases leads to a fatal program error
37
+
- (Issue #16) Cannot delete a user that is in the collection.
38
+
39
+
At the requests of some users, I added [screenshots](ProgramScreenshots) of the program and added screenshots to [ReadMe](README.md) and the [guide](https://github.com/AAndyProgram/SCrawler/wiki).
40
+
1
41
# 2.0.0.4
2
42
3
43
**Removed compatibility of program settings with version 1.0.0.4 and lower.**
A: How to request a new site you can read [here](CONTRIBUTING.md#how-to-request-a-new-site)
38
38
39
39
----
40
40
41
-
Q: **Twitter/Instagram download failed.**
41
+
#### Q: **Twitter/Instagram download failed.**
42
42
43
43
A: Check your credentials. Both of these sites require cookies. Check your [Twitter tokens](https://github.com/AAndyProgram/SCrawler/wiki/Settings#how-to-find-twitter-tokens) and [Instagram settings](https://github.com/AAndyProgram/SCrawler/wiki/Settings#instagram-settings). If all settings are set, but nothing works, go to [create a new issue](https://github.com/AAndyProgram/SCrawler/issues). Don't forget to attach the LOG.
44
44
45
45
----
46
46
47
-
Q: **Does the program remember the last download and check for new posts, downloading only new posts? Or does the program download the entire profile every time?**
47
+
#### Q: **Does the program remember the last download and check for new posts, downloading only new posts? Or does the program download the entire profile every time?**
48
48
49
-
A: The program stored posts IDs in users' folders. For the first time, the program downloads the entire profile. All subsequent times the program will check for new posts and download **only new posts**!
49
+
A: The program stored posts IDs in users' folders. For the first time, the program downloads the entire profile. All subsequent times the program will check for new posts and download **only new posts**!
50
+
51
+
----
52
+
53
+
#### Q: **How to redownload all data**
54
+
55
+
A: Double-click on the user you want to redownload. In the opened window open folder setting. Delete the files ending with ```_Data.xml``` and ```_Posts.txt```. Download this user again.
56
+
57
+
----
58
+
59
+
#### Q: **How to remove the label**
60
+
61
+
A: There is no functionality to remove an individual label. You can open the ```Labels.txt``` file in the program settings folder and delete any label you want. You also can delete this file (```Labels.txt```). In this case, when the program starts, the list of labels list will be updated with only existing labels (from the user data files).
62
+
63
+
----
64
+
65
+
#### Q: **How to remove a user from the blacklist**
66
+
67
+
A: Just add that user back to the program. In the dialog box that opens, click on the ```Add and remove from blacklist```` button.
Your support is very valuable to me. Any support is greatly appreciated. Your support encourages me to make new features, update the program, add new sites, etc.
- Download pictures and videos from users' profiles and subreddits:
16
22
- Reddit images;
@@ -19,20 +25,33 @@ Do you like this program? Consider adding to my coffee fund by making a donation
19
25
- Reddit hosted videos (downloading Reddit hosted video is going through ffmpeg (**ffmpeg only works with the x64 program**));
20
26
- Twitter images and videos;
21
27
- Instagram images and videos.
28
+
- Imgur images, galleries and videos
29
+
- Gfycat videos
30
+
-[Other](#supported-sites) supported sites
22
31
- Parse [channel and view data](https://github.com/AAndyProgram/SCrawler/wiki/Channels).
23
32
- Download [saved Reddit and Instagram posts](https://github.com/AAndyProgram/SCrawler/wiki/Home#saved-posts).
24
33
- Add users from parsed channel.
34
+
-**Advanced user management.**
25
35
- Labeling users.
36
+
- Adding users to favorites and temporary.
26
37
- Filter exists users by label or group.
27
38
- Selection of media types you want to download (images only, videos only, both)
39
+
- Download a special video, image or gallery
40
+
- Making collections (grouping users into collections)
41
+
- Specifying a user folder (for downloading data to another location)
42
+
- Changing user icons
43
+
- Changing view modes
44
+
- ...and many others...
28
45
29
46
# Supported sites
30
47
31
-
- Reddit
32
-
- Twitter
33
-
- Instagram
48
+
-**Reddit**
49
+
-**Twitter**
50
+
-**Instagram**
34
51
- RedGifs
35
52
- Imgur
53
+
- Gfycat
54
+
-[Other sites](Plugins.md)
36
55
37
56
# How does it works:
38
57
@@ -50,28 +69,42 @@ You can read about Instagram restrictions [here](https://github.com/AAndyProgram
50
69
51
70
## How to request a new site
52
71
53
-
Read [here](https://github.com/AAndyProgram/SCrawler/blob/main/CONTRIBUTING.md#how-to-request-a-new-site) about
72
+
Read [here](CONTRIBUTING.md#how-to-request-a-new-site) about
54
73
55
-
# Requirements:
74
+
# Requirements
56
75
57
76
- Windows 7, 8, 9, 10, 11 with NET Framework 4.6.1 or higher
58
77
- Authorization cookies and tokens for Twitter (if you want to download data from Twitter)
59
78
- Authorization cookies Instagram (if you want to download data from Instagram)
60
79
- ffmpeg library for downloading videos hosted on Reddit (you can download it from the [official repo](https://github.com/GyanD/codexffmpeg/releases/tag/2021-01-12-git-ca21cb1e36) or [from my first release](https://github.com/AAndyProgram/SCrawler/releases/download/1.0.0.0/ffmpeg.zip)). **ffmpeg only works with the x64 version of the program.**
61
-
-**Don't put program in the ```Program Files``` system folder (this is portable program and program settings are stored in the program folder)**
62
-
-**Just unzip the program archive to any folder, copy the file ```ffmpeg.exe``` into it and enjoy. :)**
80
+
81
+
# Guide
82
+
83
+
**Full guide you can find [here](https://github.com/AAndyProgram/SCrawler/wiki)**
84
+
85
+
# Installation
86
+
87
+
**Just unzip the program archive to any folder, copy the file ```ffmpeg.exe``` into it and enjoy.**:blush:
88
+
89
+
**Don't put program in the ```Program Files``` system folder (this is portable program and program settings are stored in the program folder)**
90
+
91
+
# Updating
92
+
93
+
Just download [latest](https://github.com/AAndyProgram/SCrawler/releases/latest) version and unpack it into the program folder. **Before starting a new version, I recommend making a backup copy of the program settings folder.**
63
94
64
95
# How to build from source
65
96
66
97
1. Delete the "PersonalUtilities" project from the solution.
67
-
2. Add the latest version of the "PersonalUtilities.dll" library (from the [latest release](https://github.com/AAndyProgram/SCrawler/releases/latest)).
68
-
3. Import PersonalUtilities.Functions for the whole project.
98
+
1. Add the latest version of the "PersonalUtilities.dll" library (from the [latest release](https://github.com/AAndyProgram/SCrawler/releases/latest)).
99
+
1. Import PersonalUtilities.Functions for the whole project.
69
100
70
-
# Updating
101
+
# How to make a plugin
71
102
72
-
Just download [latest](https://github.com/AAndyProgram/SCrawler/releases/latest) version and unpack it into the program folder. Before starting a new version, I recommend making a backup copy of the program settings folder.
103
+
Read about how to make plugin [here](https://github.com/AAndyProgram/SCrawler/wiki/Plugins).
73
104
105
+
# How to support
74
106
107
+
Read more about how to support the program [here](HowToSupport.md).
75
108
76
109
# Settings and usage
77
110
@@ -92,16 +125,16 @@ You can add users by patterns:
92
125
93
126
Read more about adding users and subreddits [here](https://github.com/AAndyProgram/SCrawler/wiki/Users)
94
127
95
-
# Guide
96
-
97
-
**Full guide you can find [here](https://github.com/AAndyProgram/SCrawler/wiki)**
Create a shortcut for the program. Open shortcut properties. In the ```Shortcut``` tab, in the ```Target``` field, just add the letter ```v``` at the end across the space.
0 commit comments