Version 5.4.0
🔔DING! DING!🔔 Dear community, we are so proud to announce that OpenCTI version 5.4.0 has been released 💥! This was a huge joint effort from the brand new Filigran engineering team as well as all community contributors 🍻. Thank you everyone for your continuous efforts to make OpenCTI the world leading threat intelligence platform 🙏!
This milestone contains important new features but also the implementation of more systematic development best practices (TypeScript, pure functions, etc.) 🧩 that will allow us to speed-up future milestones in the months and years to come 🚀.
First of all, OpenCTI 5.4.0 brings long-awaited features 🎁:
- bulk search of entities and observables in the platform 🔍;
- customization of workflow statuses for all types of entity 🛠️;
- introduce an analyst workbench to modelize entities and relationships massively and easily before create the knowledge in the platform 👩💻;
- new inference rules to propagate reports to parent entities (sectors / locations) 🗺️;
- performances improvement due to the new way to validate indicators syntax (creation of indicators speed x10) 🚅;
- it is now possible to deny connectors from creating new labels and keep a set of pre-defined labels in the platform ✨;
- country flags for IPs when
located-at
relationship is set to a specific country 🏴; - new specific capabilities for notes and opinions to allow feedback even from read-only users ✍️;
- implement the STIX 2.1 "Grouping" entity type to allow information clustering without creating a report when it is not relevant 📦;
- Japanese translation, OpenTelemetry, investigation improvements and much more 💝...
Last but not least, this release introduces a major new data segregation and sharing capability by organization 🏢. This allows administrators to associate users to organizations (organizations can belong to parent organizations as well) and to distribute knowledge across one or multiple organizations in the platform 🔓.
It is also possible to set a default organization for the whole platform to restrict all data and starting to share progressively information 🌎. A demonstration video will be published to better explain this new feature which will help organizations to open access to third-parties / constituents with full confidence about the confidentiality of the data 🥳.
⚠️ Allinternal-export-file
connectors should now be launched with a user which has theAdministrator
role, because they now impersonate the user requesting the export to prevent data leak.
⚠️ All technical creators (users) of existing entities are no longer mapped on the history and then are displayed as "SYSTEM". New entities / relationships will be created with the correct creator fully modelized. If you would like to recover the creators information of your existing data, you can launch a background task (based on the history) on the selected entities (or all of them) using the mass operations toolbarUpdate => Replace => Creator
.
⚙️ When using the organization segregation capability, it is recommended to enable the inference rule
ORGANIZATION PROPAGATION VIA PARTICIPATION
so it will propagate if a user A participates in organization B and organization B is part of organization C, then the user A also participates in organization C.
Since the last release, minio implements breaking change. If you decide to upgrade minio, a procedure must be applied. Please read https://min.io/docs/minio/linux/operations/install-deploy-manage/migrate-fs-gateway.html
Enhancements:
- #2543 [api] Improve version checking of platform start
- #2535 Be able to hide background tasks screen using RBAC capabilities
- #2530 Add new attributes to the entity incident
- #2502 Improv dev env by injecting a data set
- #2483 Be able to use workflow status in the stream filters
- #2475 Implement the "Grouping" STIX 2.1 entity as a container
- #2470 Limit the history message length both in backend (when inserting) and frontend
- #2464 Title and meta description of the platform
- #2463 [api] Add usage of impersonate feature to connectors
- #2456 Add Japanese translation
- #2446 Add "Shodan" Pattern Type to Indicators
- #2435 [api] Filters support multiples keys to search on
- #2420 Add a quick filter for sighting lists (false / true positive)
- #2408 Full refactor of pre-validation screen into an analyst workbench
- #2414 Support "content_ref" for StixFile to Artifact (obs_content ?) relation
- #2406 [Feature] Filter for 'Score less than' within Retention Policy Rules
- #2401 Improve of performance indicator checkIndicatorSyntax function
- #2397 Enhance the view of the rules definition in the frontend
- #2341 [rules] Add report objects related rules
- #2336 Bulk search of SDOs and SCOs
- #2331 Mass delete labels
- #2293 Add Infrastructure fields to UI when creating new Objects
- #2263 Ability to search OpenCTI for a list of Observables (as opposed to one by one)
- #2196 Finer access controls for Reports for feedback - Separate "Opinions" as a knowledge creation access control under roles.
- #2188 Add organizations restrictions on top of markings to increase data segregation possibilities
- #2163 Entity details edition during data import
- #2116 Session refresh on user rights change
- #2109 Create/Update notes and opinions specifying author with a different user
- #2029 Add technical creator in data + ordering/filtering
- #1991 Exporting Report details, Malware or Intrusion Sets is hard to do
- #1943 Ability to create additional custom workflow status names straight from the UI if possible.
- #1934 Ability to expand to any kind of entity from Investigations Workspace
- #1867 Removing report
- #1799 Bulk creation of knowledge around a threat entity
- #1781 STIX ID standard is useless to analysts but have the most visible spot in item pages
- #1757 Add Indicator to Report when Observable+Indicator created within the context of a Report
- #1755 Be able to select labels to import
- #1730 Add country flag icons to IPv4/IPv6 observables
- #1596 Expose worker metrics for prometheus
- #1468 Remove entities after report deletion
- #1428 Suppressing an entity does not suppress its relations
- #1182 Infrastructure, Systems and Vulnerabilities
- #1071 No way to implement STIX's Windows Service (and Process) extensions
Bug Fixes:
- #2550 Events/Incidents/Observables. Doesn't display more than 25 observables.
- #2487 Empty channels type break the UI
- #2448 Pending Imports UI potentially referencing incorrect path for STIX bundles when APP__BASE_PATH is set
Pull Requests:
- [api] Add OpenTelemetry for tracing and metrics (#1596) by @richard-julien in #2439
- [Tool] Update some files for dev env setup by @Kedae in #2440
- [api] Filters support multiples keys to search on (#2435) by @Kedae in #2444
- [api] Introduce impersonate capability for bypass role (#1755) by @richard-julien in #2445
- [api] Fix missing filters on graphQL and update of elastic size for d… by @Kedae in #2451
- Add locale ja jp (#5) by @kohsawa in #2455
- [api/front] Bump librairies + adapt front testing by @richard-julien in #2458
- [front] Add quick filter to Sightings qualification by @Kedae in #2453
- [api] Improve performance of python execution (#2401) by @richard-julien in #2461
- [front] Add lte on score for retention by adding a grouped filter by @Kedae in #2457
- [api/frontend] Implement a first version of the analyst workbench (#2408) by @SamuelHassine in #2466
- [Front] add the possibility to select a type in the infrastructure cr… by @Archidoit in #2471
- [api/front] Default rendering of title and meta description (#2464) by @richard-julien in #2465
- [api] Add rabbitmq queue_prefix and improve dev testing by @richard-julien in #2479
- [api] Session lazy refresh on user rights/roles/groups modifications (#2116) by @richard-julien in #2480
- [api] Add support of content_ref in Stix file for Artifact by @Kedae in #2468
- [Back] StatusTemplate creation (#1943) by @Archidoit in #2477
- [api/front] Implement process extensions (#1071) by @richard-julien in #2405
- [frontend] Fix channels list if types is empty (#2487) by @SamuelHassine in #2492
- [rules] Add report objects related rules (#2341) by @richard-julien in #2375
- [api/frontend] Implement the "Grouping" STIX 2.1 entity as a container (#2475) by @SamuelHassine in #2501
- [api] Improv dev env by injecting a data set (#2502) by @RomuDeuxfois in #2527
- Add "Shodan" Pattern Type to Indicators (#2446) by @RomuDeuxfois in #2537
- [api/frontend] Truncate history message when they are too long (#2470) by @Kedae in #2494
- [api/frontend] Remove entities after report deletion (#1468) by @SamuelHassine in #2524
- [tools] Fix on insert:dev by @Kedae in #2542
- [frontend] Hide background task when cannot update knowledge (#2535) by @SamuelHassine in #2539
- [api/frontend] Re-organize sightings menu, add attack patterns export button (#1182, #1991) by @SamuelHassine in #2538
- [api/frontend] Full refactor of the rules list screen (#2397) by @SamuelHassine in #2525
- [frontend] Adapt overview of objects lowering ID importance (#1781) by @SamuelHassine in #2489
- [back] Upgrade librairies + migration jest -> vitest by @richard-julien in #2552
- [api/frontend] Add country flag icons to IPv4/IPv6 observables (#1730) by @SamuelHassine in #2549
- [frontend] Add technical creator in data + ordering/filtering (#2029) by @SamuelHassine in #2495
- [api/frontend] New attributes for incidents (#2530) by @SamuelHassine in #2532
- [api/frontend] Enhance search screen with table and number of reports (#2336, #2263) by @SamuelHassine in #2557
- [frontend] Be able to expand all types of entity / relations in investigations (#1934) by @SamuelHassine in #2490
- [front] Add needed configuration for types by @Kedae in #2565
- [api/frontend] Add organizations restrictions on top of markings to increase data segregation possibilities (#2188) by @richard-julien in #2317
- [api/frontend] Status Template creation, deletion, edition (#1943) by @Archidoit in #2548
- Segregation upgrade by @richard-julien in #2573
- [back/frontend] Improve backend meta relationships creation and segregation rule by @richard-julien in #2576
New Contributors:
- @Kedae made their first contribution in #2440
- @kohsawa made their first contribution in #2455
- @Archidoit made their first contribution in #2471
- @RomuDeuxfois made their first contribution in #2527
- @SarahBocognano joined the team!
Full Changelog: 5.3.17...5.4.0