Change log for MISP_IOC
| Date | Changes |
|---|---|
| 2026-07-16 |
Enhancement: - event.idm.entity.entity.file.names: Newly mapped Attribute.Event.value raw log fields with event.idm.entity.entity.file.names UDM field when log_type is email-attachment.
|
| 2026-07-02 |
Enhancement: - event.idm.entity.metadata.threat.description: Newly mapped Attribute.Event.info raw log field with event.idm.entity.metadata.threat.description UDM field.- event.idm.entity.metadata.threat.detection_fields: Newly mapped Attribute.Event.ThreatLevel.name, Attribute.Event.ThreatLevel.id, Attribute.Event.Orgc.uuid, Attribute.Event.Orgc.name, Attribute.Event.Org.uuid, Attribute.Event.Org.name, Attribute.Event.publish_timestamp, Attribute.Event.timestamp, Attribute.Event.date, Attribute.Event.analysis, Attribute.Event.threat_level_id, Attribute.Event.user_id, Attribute.Event.orgc_id, Attribute.Event.org_id, Attribute.type, and log_source raw log fields with event.idm.entity.metadata.threat.detection_fields UDM field.- event.idm.entity.entity.asset.product_object_id: Newly mapped Attribute.Event.uuid raw log field with event.idm.entity.entity.asset.product_object_id UDM field.- event.idm.entity.metadata.entity_type: Added conditional logic to set the field to USER when user email details are present and the raw log field log_type is email.
|
| 2026-06-22 |
Enhancement: - event.idm.entity.entity.user.email_addresses: Newly mapped value raw log field with event.idm.entity.entity.user.email_addresses UDM field when type is threat-actor.- event.idm.entity.entity.hostname: Newly mapped host raw log field with event.idm.entity.entity.hostname UDM field when type is hostname|port or hostname.- event.idm.entity.entity.port: Newly mapped port raw log field with event.idm.entity.entity.port UDM field when type is hostname|port.- event.idm.entity.metadata.entity_type: Newly set event.idm.entity.metadata.entity_type to DOMAIN_NAME when type is hostname|port.
|
| 2026-01-22 |
Enhancement: - Added a new support to parse the new format of logs. - event.idm.read_only_udm.entity.metadata.collected_timestamp: Newly mapped from column19 raw log field with event.idm.read_only_udm.entity.metadata.collected_timestamp UDM field.- event.idm.read_only_udm.entity.additional.fields: Newly mapped from attributes.log_file_name raw log field with event.idm.read_only_udm.entity.additional.fields UDM field.- event.idm.read_only_udm.entity.additional.fields: Newly mapped from attributes.log_type raw log field with event.idm.read_only_udm.entity.additional.fields UDM field.- event.idm.read_only_udm.entity.entity.labels: Newly mapped column2, column7, column11, column12, column14, column16, column17, column18 raw log fields with event.idm.read_only_udm.entity.entity.labels UDM field.
|
| 2026-01-07 |
Enhancement: - event.idm.entity.entity.labels: Newly mapped column9, column11, column12, column13 raw log field(s) with event.idm.read_only_udm.entity.labels UDM field. These are conditionally mapped to labels including actor_name, country, misp_galaxy_tag, tlp, and vulnerability.- event.idm.entity.metadata.threat.threat_feed_name: Newly mapped the value to MISP when the event_source_org field is not available.- event.idm.entity.metadata.interval.start_time: Converted type to UNIX timestamp. If ts1 is empty, non-numeric, or zero, it is set to 1 before conversion.- Added conditional logic to handle multiple CSV formats based on the content of column11 and column12. - Added a conditional check for ts1 to determine whether to use it or @timestamp for date parsing. - event.idm.entity.entity.labels: The intelligence_source field is now conditionally mapped from either column11 or column15 depending on the log format.
|
| 2025-12-24 |
Enhancement: - event.idm.entity.metadata.threat.detection_fields: Newly mapped name, comment,Attribute.last_seen,first_seen, Org.id, Org.uuid, Org.local, Orgc.id, Orgc.uuid, Orgc.local, Attribute.distribution, Attribute.interval_start, Attribute.interval_end, Attribute.sharing_group_id, Attribute.disable_correlation, Attribute.object_id, Attribute.object_relation, log.id, log.event_id, log.distribution, interval_start, interval_end, template_uuid, meta-category, log.sharing_group_id, log.disable_correlation, log.object_id, log.object_relation, Tag raw log field(s) with event.idm.entity.metadata.threat.detection_fields UDM field.- Added conditional check for log_type to handle x509-fingerprint-sha256 to set event.idm.entity.metadata.entity_type to FILE and map Attribute.value to event.idm.entity.entity.file.sha256 UDM field.- event.idm.entity.entity.hostname: Newly mapped Attribute.value raw log field(s) with event.idm.entity.entity.hostname UDM field when log_type is target-org.- event.idm.entity.metadata.entity_type: Set the event.idm.entity.metadata.entity_type to DOMAIN_NAME when log_type is target-org.- Added conditional check for log_type to handle [link,URL embedded in the email] to set event.idm.entity.metadata.entity_type to URL and map Attribute.value to event.idm.entity.entity.url UDM field.- event.idm.entity.entity.hostname: Newly mapped Orgc.name raw log field(s) with event.idm.entity.entity.hostname UDM field when log_type is text.- event.idm.entity.metadata.entity_type: Set the event.idm.entity.metadata.entity_type to DOMAIN_NAME when log_type is text.- Removed text from the log_type list for which events are dropped and added a conditional check for log_type to handle text to set event.idm.entity.metadata.entity_type to DOMAIN_NAME and map Orgc.name to event.idm.entity.entity.hostname UDM field.- Added conditional check for log_type to handle email-dst to set event.idm.entity.metadata.entity_type to USER and map Attribute.value to event.idm.entity.entity.user.email_addresses UDM field.- Converted Attribute.id ,Attribute.event_id, log.id,log.event_id, Attribute.timestamp,log.timestamp to string before its mapping.- Removed == and used =~ operator for logtype sha256 to handle logs where type contains sha256.- Added a null conditional check for log.comment field before mapping it to event.idm.entity.metadata.threat.detection_fields to prevent populating null values.
|
| 2025-10-06 |
Enhancement: - event.idm.entity.entity.port: Newly mapped port field with event.idm.entity.entity.port UDM field.- event.idm.entity.entity.labels: Newly mapped column2 , column10 , column15 , column22 , column20 field with event.idm.entity.entity.labels UDM field.
|
| 2025-06-26 |
Enhancement: - Merged the output only when the event.idm.entity.metadata.entity_type is set.- event.idm.entity.metadata.product_entity_id: Newly mapped log.uuid raw log field with event.idm.entity.metadata.product_entity_id UDM field.- event.idm.entity.metadata.description: Newly mapped Event.info raw log field with event.idm.entity.metadata.description UDM field.- event.idm.entity.metadata.interval.start_time: Newly mapped entity_first_seen raw log field with event.idm.entity.metadata.interval.start_time UDM field.- event.idm.entity.metadata.threat.category_details: Newly mapped log.category raw log field with event.idm.entity.metadata.threat.category_details UDM field.- event.idm.entity.metadata.threat.summary: Newly mapped log.comment raw log field with event.idm.entity.metadata.threat.summary UDM field.- event.idm.entity.entity.labels: Newly mapped Event.threat_level_id and event_creator_email raw log fields with event.idm.entity.entity.labels UDM field.- event.idm.entity.entity.file.full_path: Newly mapped log.comment raw log field with event.idm.entity.entity.file.full_path UDM field, if the type is md5, sha1, sha256, attachment or email-attachment and log.comment is not Artifacts dropped.Newly mapped log.value raw log field with event.idm.entity.entity.file.full_path UDM field, if the type is filename.Newly mapped file_name raw log field with event.idm.entity.entity.file.full_path UDM field, if the type is filename|sha256.- event.idm.entity.entity.file.sha256: Newly mapped log.value raw log field with event.idm.entity.entity.file.sha256 UDM field, if the type is sha256.Newly mapped file_sha256 raw log field with event.idm.entity.entity.file.sha256 UDM field, if the type is filename|sha256.- event.idm.entity.entity.file.sha1: Newly mapped log.value raw log field with event.idm.entity.entity.file.sha1 UDM field, if the type is sha1.- event.idm.entity.entity.file.md5: Newly mapped log.value raw log field with event.idm.entity.entity.file.md5 UDM field, if the type is md5.- event.idm.entity.entity.hostname: Newly mapped log.value raw log field with event.idm.entity.entity.hostname UDM field, if the type is domain or hostname.- Mapped Attribute.value to event.idm.entity.entity.hostname, when log.type is hostname.- event.idm.entity.entity.ip: Newly mapped ip raw log field with event.idm.entity.entity.ip UDM field, if the type is ip-dst|port, ip-dst or ip-src.- event.idm.entity.entity.port: Newly mapped port raw log field with event.idm.entity.entity.port UDM field, if the type is ip-dst|port.- event.idm.entity.entity.resource.name: Newly mapped log.value raw log field with event.idm.entity.entity.resource.name UDM field, if the type is mutex.- event.idm.entity.entity.registry.registry_key: Newly mapped log.value raw log field with event.idm.entity.entity.registry.registry_key UDM field, if the type is regkey.- event.idm.entity.entity.user.email_addresses: Newly mapped log.value raw log field with event.idm.entity.entity.user.email_addresses UDM field, if the type is threat-actor, email-src, email or email-subject.- event.idm.entity.entity.user.user_display_name: Newly mapped log.uuid raw log field with event.idm.entity.entity.user.user_display_name UDM field, if the type is email or email-subject.- event.idm.entity.entity.url: Newly mapped log.value raw log field with event.idm.entity.entity.url UDM field, if the type is uri, url, URL embedded in the email or link.- event.idm.entity.metadata.entity_type: Set the event.idm.entity.metadata.entity_type based on the log.type field.- event.idm.entity.metadata.threat.detection_fields: Newly mapped log.id, log.event_id, log.to_ids, log.timestamp, log.comment, log.deleted, log.first_seen, Org.name, Feed.publish, published and Event.Tag raw log fields with event.idm.entity.metadata.threat.detection_fields UDM field.
|
| 2025-04-10 |
Enhancement: - Merged the output only when the event.idm.entity.metadata.entity_type is set.- syslog+json: Added support for syslog+json format.- event.idm.entity.metadata.entity_timestamp: Newly mapped timestamp raw log field with event.idm.entity.metadata.entity_timestamp UDM field.- event.idm.entity.metadata.interval.start_time: Newly mapped first_seen raw log field with "event.idm.entity.metadata.interval.start_time` UDM field.- event.idm.entity.metadata.interval.end_time: Newly mapped last_seen raw log field with "event.idm.entity.metadata.interval.end_time` UDM field.- event.idm.entity.entity.file.sha1: Newly mapped indicator raw log field with event.idm.entity.entity.file.sha1 UDM field, if the type is sha1.- event.idm.entity.entity.file.md5: Newly mapped indicator raw log field with event.idm.entity.entity.file.md5 UDM field, if the type is md5.- event.idm.entity.entity.file.sha256: Newly mapped indicator raw log field with event.idm.entity.entity.file.sha256 UDM field, if the type is sha256.- event.idm.entity.entity.hostname: Newly mapped indicator raw log field with event.idm.entity.entity.hostname UDM field, if the type is domain.- event.idm.entity.entity.ip: Newly mapped indicator raw log field with event.idm.entity.entity.ip UDM field, if the type is IPv4.- event.idm.entity.entity.url: Newly mapped indicator raw log field with event.idm.entity.entity.url UDM field, if the type is url.- event.idm.entity.metadata.threat.confidence_score: Newly mapped confidence raw log field with event.idm.entity.metadata.threat.confidence_score UDM field.- event.idm.entity.metadata.threat.summary: Newly mapped stix_package_title raw log field with event.idm.entity.metadata.threat.summary UDM field.- event.idm.entity.metadata.threat.category_details: Newly mapped type raw log field with event.idm.entity.metadata.threat.category_details UDM field.- Set the event.idm.entity.metadata.entity_type to USER only when event.idm.entity.entity.user.email_addresses is present.
|
| 2025-03-20 |
Enhancement: - Added gsub to parse array format of logs. - Mapped confidence to threat_.confidence_details.- Mapped value to entity.entity.url when type is url.- Mapped value to entity.entity.hostname when type is domain or domiain.- Mapped value to entity.entity.ip when type is ip.- Mapped value to entity.entity.file.sha256 when type is sha256.- Mapped value to entity.entity.file.md5 when type is md5.- Mapped value to entity.entity.file.sha1 when type is hash.- Set entity.metadata.entity_type based on the type field.- Added on_error to log.comment mapping to handle the error when log.comment is not present in the log.
|
| 2025-01-29 |
Enhancement: - Added support to parse new format of JSON unparsed logs. |
| 2024-11-20 |
Enhancement: - Added support to parse unparsed logs. |
| 2024-09-05 |
Enhancement: - Added support to parse unparsed logs. |
| 2023-09-26 |
Enhancement: - Mapped published, Feed.publish, Org.name, Attribute.id, Attribute.event_id, Attribute.to_ids, Attribute.timestamp, Attribute.comment, Attribute.deleted, Attribute.first_seen, all tag.names to threat.detection_fields.
|
| 2023-08-17 |
Bug-Fix : - Added a condition to perform a gsub operation, that removes extra back-slash, only when log is not JSON.
|
| 2023-07-20 |
Bug-Fix : - Changed metadata.entity_type to MUTEX when log is of type mutex.
|
| 2023-07-04 | Newly created parser. |