NEWS

# Releases

## GrimoireLab 1.9.0 - (2024-12-11)

**New components:**

* grimoirelab-toolkit 1.0.8
* kidash 1.0.9
* sortinghat 1.6.0
* cereslib 1.0.8
* perceval 1.1.0
* perceval-mozilla 1.0.10
* perceval-opnfv 1.0.10
* perceval-puppet 1.0.10
* perceval-weblate 1.0.10
* graal 1.1.1
* grimoire-elk 1.3.2
* sirmordred 1.1.4

The following list describes the changes by component:

### grimoirelab-toolkit
  
  * Update Poetry's package dependencies

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**New features:**

 * Skip recommendations (#937)\
   Users can now skip a recommendation and review the next one if they
   are unsure of whether to apply it or dismiss it.
 * Sort organizations by number of enrollments (#940)\
   Organizations are now sorted by the number of enrollments they have by
   default. Clicking on a column header sorts the table results by that
   field.

### cereslib
  
  * Update Poetry's package dependencies

### perceval

**Bug fixes:**

 * Git stats not assigned with their actions\
   Git stats were not assigned to their actions in a commit for filenames
   that contain whitespaces. Instead, an empty stat was created like in a
   merge commit, where actions normally don't take place.

**Performance improvements:**

 * Git sync improved for `--latest-items` flag\
   The speed updating a git repository when `--lates-items` is set was
   very poor. The main problem was when the references were updated to
   the new hashes. All the active refs on the repository were modified,
   even when they were up-to-date. Now, only references updated on the
   remote repository are modified on the local one. Repositories are
   synched 2 times faster than before.

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 1.8.0 - (2024-11-13)

**New components:**

* grimoirelab-toolkit 1.0.7
* kidash 1.0.8
* sortinghat 1.5.1
* cereslib 1.0.7
* perceval 1.0.9
* perceval-mozilla 1.0.9
* perceval-opnfv 1.0.9
* perceval-puppet 1.0.9
* perceval-weblate 1.0.9
* graal 1.1.0
* grimoire-elk 1.3.1
* sirmordred 1.1.3

The following list describes the changes by component:

### grimoirelab-toolkit
  
  * Update Poetry's package dependencies

### kidash
  
  * Update Poetry's package dependencies

### sortinghat
  
  * Update Poetry's package dependencies

### cereslib
  
  * Update Poetry's package dependencies

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla

**Bug fixes:**

 * Kitsune resuming feature fixed (#79)\
   Kitsune backend resuming feature was broken. It didn't retrieve the
   updated questions right using the parameter 'offset'. Changing the
   backend to use 'from-date' parameter instead has fixed the problem.

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal

**New features:**

 * Compatible namespace package for Python 3.12\
   Remove old format to define namespace packages. And use native
   namespace packages that requires removing the `__init__.py` file. It
   is important that every distribution that uses the namespace package
   omits that file. For more information see
   https://peps.python.org/pep-0420/

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred

**Bug fixes:**

 * Panels import bug and Micro Mordred failure\
   A bug was causing Panels to fail to import in Kibiter and preventing
   micro Mordred from working. The issue was in tasks that didn’t require
   a SortingHat client to run.


## GrimoireLab 1.7.0 - (2024-10-15)

**New components:**

* grimoirelab-toolkit 1.0.6
* kidash 1.0.7
* sortinghat 1.5.0
* cereslib 1.0.6
* perceval 1.0.8
* perceval-mozilla 1.0.8
* perceval-opnfv 1.0.8
* perceval-puppet 1.0.8
* perceval-weblate 1.0.8
* graal 1.0.8
* grimoire-elk 1.3.0
* sirmordred 1.1.2

The following list describes the changes by component:

### grimoirelab-toolkit
  
  * Update Poetry's package dependencies

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**New features:**

 * Mark individuals as reviewed\
   Individuals can now be marked as reviewed to keep track of which
   profiles have already been checked and when. A profile can be marked
   as reviewed more than once, it will show the date of the last review.
   If there have been any changes to the profile data since the last
   review, the review button displays a warning icon. The list of
   individuals can be filtered by whether they have been reviewed and by
   their review date. The list can also be ordered by review date.

**Bug fixes:**

 * Wrong arrong direction when merging recommendations (#934)\
   When recommendations were merged, the arrow showing the direction of
   the merge was wrong. It showed `foo → bar` but the resulting identity
   will be named `foo` instead of `bar`. The arrow now points in the
   other direction showing that `bar` will be merged on `foo`.

### cereslib
  
  * Update Poetry's package dependencies

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk

**New features:**

 * Keywords data on enriched items\
   Keywords field is included now on the enriched items of bugzilla and
   bugzillarest indices.
 * New reponse times on bugzilla items\
   The Bugzilla enriched items include two new fields to track response
   times on these type of repositories. The field
   `time_to_first_attention` is the the time expressed in days between
   the ticket creation and the first comment from a contributor different
   from the author creating the bug. The field `last_comment_date` is the
   date of the last comment posted in the bug.

**Bug fixes:**

 * All references processed for the reference analysis study\
   The `enrich_reference_analysis` study analyzes the cross-references
   between "issues" and "pull request". When we use an aggregations
   query, it returns only the first 10 items (ElasticSearch/OpenSearch by
   default). By using 'composite aggregations', we can paginate the
   result and thus, obtain all the references.

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 1.6.0 - (2024-09-23)

**New components:**

* grimoirelab-toolkit 1.0.5
* kidash 1.0.6
* sortinghat 1.4.0
* cereslib 1.0.5
* sigils 1.1.1
* perceval 1.0.7
* perceval-mozilla 1.0.7
* perceval-opnfv 1.0.7
* perceval-puppet 1.0.7
* perceval-weblate 1.0.7
* graal 1.0.7
* grimoire-elk 1.2.0
* sirmordred 1.1.1

The following list describes the changes by component:

### grimoirelab-toolkit

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project.

### kidash

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project.

### sortinghat

**New features:**

 * Less distracting main identity indicator (#920)\
   The star icon that marked an individual's main identity was
   distracting and potentially misleading for users. It has changed to a
   more subtle indicator since it is not relevant for most users.
 * Redirect to the original URL after log in (#925)\
   Users are now redirected to the page they originally requested after
   they log in.
 * Merge organizations when adding an alias\
   Users now have the option to merge the organizations when adding an
   alias that already exists on the "Edit organization" dialog. That
   option was only previously available at the organization's detail
   page.
 * Customizable trusted sources for username matching\
   Enable customization of trusted sources for username matching in
   settings. This feature allows to define and manage the trusted data
   sources for username matching from the configuration.

**Bug fixes:**

 * Users permissions migrated (#849)\
   User permissions are stored in a separate table within the database.
   These permissions will be automatically migrated when running
   `sortinghat-admin upgrade`.
 * Update workspace when identities are split (#919)\
   When an individual's identities are split, they are shown in the
   workspace, but they were only shown the first time. The workspace is
   now updated with the new individuals every time.

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project. Update the Docker images
   to use Python 3.9.

### cereslib

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project.

### sigils

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project.

### perceval

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project.

### perceval-mozilla

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project.

### perceval-opnfv

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project.

### perceval-puppet

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project.

### perceval-weblate

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project.

### graal

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project.

### grimoire-elk

**New features:**

 * Status in SUMO enriched index\
   Add the missing status in the SUMO backend. The status could be
   `solved`, `archived`, `locked` or `open`.

**Bug fixes:**

 * Avoid UNDEFINED values in author fields\
   Avoid `-- UNDEFINED --` values for all SortingHat fields when Mordred
   loses connection to the SortingHat server during the enrichment or
   autorefresh execution. It will keep the values of the `name`, `email`,
   `id` and `uuid` fields.
 * Handle OpenSearch page info on pagination\
   In OpenSearch and ElasticSearch < 7.x the page info on pagination is
   different. This will handle both of them.

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project.

### sirmordred

**Dependencies updateds:**

 * Python minimum version updated\
   Python 3.8 will reach its end of life in October 2024. Python 3.9 is
   the minimum version required by the project.


## GrimoireLab 1.5.0 - (2024-08-30)

**New components:**

* kidash 1.0.5
* sortinghat 1.3.0
* perceval 1.0.6
* perceval-mozilla 1.0.6
* perceval-opnfv 1.0.6
* perceval-puppet 1.0.6
* perceval-weblate 1.0.6
* graal 1.0.6
* grimoire-elk 1.1.5
* sirmordred 1.1.0

The following list describes the changes by component:

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**New features:**

 * Remove merge recommendations (#883)\
   Recommendations can now be deleted from the database and not just
   dismissed. This is useful in case there are too many recommendations
   to handle manually.
 * Merge organizations when adding an alias (#913)\
   When adding an alias on an organization's page, if the new alias is an
   existing organization, users now have the option to merge them. This
   is useful in cases where organizations can't be merged using drag and
   drop.
 * User permissions per tenant\
   Update the permissions system to allow assigning permissions to users
   based on the tenant they are accessing. The command `sortinghat-admin
   set-group` has been renamed to `sortinghat.-admin set-permissions`.

**Bug fixes:**

 * Duplicated GitHub links (#912)\
   The link to an individual's GitHub profile no longer appears several
   times when there is more than one GitHub identity.
 * Connection closed when job is executed\
   RQ workers create a fork to run the jobs. The issue arises when, after
   completing the job, the MariaDB logs display the warning: `Aborted
   connection to db. Got an error reading communication packets`. This
   change ensures the database connection is closed before the fork ends,
   preventing the warning from appearing.

### perceval

**Bug fixes:**

 * Fix issue #782 (#782)\
   The issue was that perceval would not delete old tags from upstream
   references. This change deletes tags locally if tags are deleted
   upstream.

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk

**Bug fixes:**

 * Git branches study improved\
   Previously, while the branches study was running, the `branches` field
   remained empty or partially filled until the study was completed,
   leading to incorrect data being displayed on the dashboard. With this
   change, the branches field is updated only after the study has
   finished.

### sirmordred

**Performance improvements:**

 * Reduced the number of connections to SortingHat\
   Mordred makes a lot of connections to the SortingHat server which
   could cause the uWSGI queue to fill up. When the uWSGI queue is full,
   Mordred cannot connect to the SortingHat server.


# GrimoireLab 1.0.0

For eight years, we have been working to produce the best platform for
software development analytics possible. With the work of more than
150 developers and after over 11,600 commits, we’re excited to announce
the release of the first major version of GrimoireLab.

GrimoireLab is an evolution of the work done during more than 10 years by
[Bitergia](https://bitergia.com/), LibreSoft URJC research group, and several
contributors in [Metrics Grimoire](http://metricsgrimoire.github.io/)
and [VizGrimorie](http://vizgrimoire.bitergia.org/) projects.
Since 2017, GrimoireLab has been part of The Linux Foundation
[CHAOSS Software](http://chaoss.community) community as one of its founding
projects.

GrimoireLab has become the de facto standard for open source project
health dashboards. It has been used by some of the most important
software companies and open source foundations in the world.
The platform has also been used as the underlying foundation for
other applications, including
[Bitergia Analytics](https://github.com/bitergia-analytics),
[OSS Compass](https://compass.gitee.com/),
[LFX Insights](https://lfx.linuxfoundation.org/tools/insights/),
[Cauldron](https://gitlab.com/cauldronio/), and
[Mystic](https://opensource.ieee.org/rit/mystic-group).

This release of GrimoireLab includes:

- An automated platform to generate software analytics and insights.
- Data collection from more than 30 data sources.
- Generation of more than 150 metrics and visualizations to understand activity,
  performance, and community of open source projects.
- Identities manager to track the activity of an individual across platforms
  and organizations.
- Integration with third-party applications to visualize and analyze data
  (Kibana/OpenSearch Dashboards/Jupiter Notebooks).

This release would not have been possible without the help of the entire
community. We are deeply thankful to all our users. We would especially
like to thank Álvaro del Castillo, Valerio Cosentino, Jesús González-Barahona,
Alberto Pérez García-Plaza, J. Manrique López, Venu Vardhan Reddy Tekula,
David Moreno, Gregorio Robles, Andy Grunwald, and the members of the
CHAOSS project.

Special recognition to [Bitergia](https://bitergia.com/) and
[The Document Foundation](https://www.documentfoundation.org/)
for being early adopters.

The GrimoireLab Developers.


## GrimoireLab 0.24.0 - (2024-03-27)

**New components:**

* grimoirelab-toolkit 0.4.5
* kidash 0.6.9
* sortinghat 0.21.2
* cereslib 0.5.6
* perceval 0.25.0
* perceval-mozilla 0.4.3
* perceval-opnfv 0.2.25
* perceval-puppet 0.2.25
* perceval-weblate 0.2.25
* graal 0.4.25
* grimoire-elk 0.111.1
* sirmordred 0.10.11

The following list describes the changes by component:

### grimoirelab-toolkit
  
  * Update Poetry's package dependencies

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**Bug fixes:**

 * Refetch general settings after they are changed\
   The "unify" and "affiliate" switches on the general settings page
   sometimes reflected outdated information. The page now reloads the
   data everytime it is visited to keep it updated.

**Dependencies updateds:**

 * Migration to Vue 3\
   Vue 2 reached end of life on December 2023 and is no longer mantained.

### cereslib
  
  * Update Poetry's package dependencies

### perceval

**New features:**

 * Include recovery mode for Git backend\
   Include a new option in Git that allows continuing to fetch commits
   from the previous execution using the last commit. The option is
   `--recovery <commit>`. The last commit can be obtained from the offset
   in the summary object of the last execution or the last item.

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk

**Bug fixes:**

 * Kitsune inmerse terms error\
   Update raw mapping of Kitsune indexes to handle immense terms found in
   `data.answers_data.content`, and `data.content`.

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.23.0 - (2024-03-12)

**New components:**

* grimoirelab-toolkit 0.4.4
* kidash 0.6.8
* sortinghat 0.21.1
* cereslib 0.5.5
* perceval 0.24.1
* perceval-mozilla 0.4.2
* perceval-opnfv 0.2.24
* perceval-puppet 0.2.24
* perceval-weblate 0.2.24
* graal 0.4.24
* grimoire-elk 0.111.0
* sirmordred 0.10.10

The following list describes the changes by component:

### grimoirelab-toolkit
  
  * Update Poetry's package dependencies

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**Bug fixes:**

 * Profile view displays correct recommendations (#864)\
   The profile view now correctly displays all recommendations for an
   individual, excluding those that have been dismissed.

### cereslib
  
  * Update Poetry's package dependencies

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk

**New features:**

 * Kitsune demography study\
   Include demography study in Kitsune (SUMO). And update the index to
   include standard fields such as a unique identifier (`id`) and some
   missing fields like `origin` or `uuid`.

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.22.0 - (2024-03-01)

**New components:**

* grimoirelab-toolkit 0.4.3
* kidash 0.6.7
* sortinghat 0.21.0
* cereslib 0.5.4
* perceval 0.24.0
* perceval-mozilla 0.4.1
* perceval-opnfv 0.2.23
* perceval-puppet 0.2.23
* perceval-weblate 0.2.23
* graal 0.4.23
* grimoire-elk 0.110.0
* sirmordred 0.10.9

The following list describes the changes by component:

### grimoirelab-toolkit
  
  * Update Poetry's package dependencies

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**New features:**

 * Dedicated queues in multi-tenancy\
   This new feature allows to run jobs in dedicated queues when multi-
   tenancy is active. Therefore, tenants that require more computing
   time, can run in a separate environment without taking the resources
   of others. This new feature changes the format of the `tenants.json`
   file, so please update it before you install this new version. You can
   find more info about how to configure it in the `README.md` file.

**Bug fixes:**

 * Match recommendations job fixed\
   Fix the bug in recommend matches jobs that was causing it not to
   recommend any matches.

**Dependencies updateds:**

 * Drop support of Node.js <18\
   Versions 14 to 16 of Node.js are no longer mantained. The current
   supported versions are 18 to 20.

### cereslib
  
  * Update Poetry's package dependencies

### perceval

**New deprecations:**

 * NNTP backend deprecated\
   NNTP is deprecated. It is not compatible with Python 3.11.8 and will
   be removed in a future version.

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk

**New features:**

 * Kitsune raw mapping updated\
   Update the mapping for Kitsune backend to fix an error inserting
   Perceval items in the raw index when the field 'data.metadata.value'
   is too big.

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.21.0 - (2024-02-19)

**New components:**

* sortinghat 0.20.0
* perceval-mozilla 0.4.0
* grimoire-elk 0.109.8
* sirmordred 0.10.8

The following list describes the changes by component:

### sortinghat

**New features:**

 * Organization aliases (#857)\
   Organizations can be known by different names. To avoid duplicates,
   organizations can have aliases. Searching for an organization using
   one of its aliases returns the organization. When an organization is
   merged into another, its name becomes an alias of the target
   organization. If a name exists as an alias, no organization can be
   created with that name and viceversa. An organization's aliases can be
   added and deleted both on the organizations table and the single
   organization view.

### perceval-mozilla

**New features:**

 * Retry Kitsune when rate limited\
   Kitsune now includes the `--sleep-for-rate` option to manage `429 Too
   Many Requests` errors. You can configure retries and sleep duration
   using the `--max-retries` and `--sleep-time` options respectively.

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.20.2 - (2024-02-08)

**New components:**

* kidash 0.6.6
* sortinghat 0.19.2
* cereslib 0.5.3
* perceval 0.23.6
* perceval-mozilla 0.3.22
* perceval-opnfv 0.2.22
* perceval-puppet 0.2.22
* perceval-weblate 0.2.22
* graal 0.4.22
* grimoire-elk 0.109.7
* sirmordred 0.10.7

The following list describes the changes by component:

### kidash
  
  * Update Poetry's package dependencies

### sortinghat
  
  * Update Poetry's package dependencies

### cereslib
  
  * Update Poetry's package dependencies

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk

**Bug fixes:**

 * Bug on some backends enrichment\
   Mediawiki, Meetup are Jira were failing to retrieve the enrollment for
   an identity.

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.20.1 - (2024-02-01)

**New components:**

* sortinghat 0.19.1
* graal 0.4.21
* grimoire-elk 0.109.6
* sirmordred 0.10.6

The following list describes the changes by component:

### sortinghat

**Bug fixes:**

 * Fix "Table 'django_session' doesn't exist" error\
   Fixes the "Table 'django_session' doesn't exist" error for new
   installs. For existing databases, run the following commands to create
   the table: ``` django-admin migrate --fake sessions zero django-admin
   migrate ```

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.20.0 - (2024-01-30)

**New components:**

* grimoirelab-toolkit 0.4.2
* kidash 0.6.5
* sortinghat 0.19.0
* cereslib 0.5.2
* perceval 0.23.5
* perceval-mozilla 0.3.21
* perceval-opnfv 0.2.21
* perceval-puppet 0.2.21
* perceval-weblate 0.2.21
* graal 0.4.20
* grimoire-elk 0.109.5
* sirmordred 0.10.5

The following list describes the changes by component:

### grimoirelab-toolkit
  
  * Update Poetry's package dependencies

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**New features:**

 * Unify identities with same source\
   Include a new option to only recommend or unify identities from
   trusted sources like GitHub or GitLab that have the same username and
   backend.

**Bug fixes:**

 * Use correct base URL for login and change password API calls (#851)\
   The URLs called to login and change password now use the public path
   found in vue.config.js if no API URL is specified.
 * Authentication required fixed\
   When the AUTHENTICATION_REQUIRED setting is set to False, any query to
   the API is allowed.
 * Display individual's most recent organization\
   The individual's current affiliation is now the most recent one
   instead of the oldest.
 * CSRF token is only required on web requests\
   The GraphQL API required the 'X-CSRFToken' header, but the token could
   only be retrieved by making a GET request. Now, requests authenticated
   using JWT don't need to provide the CSRF token and only the user
   interface, which is vulnerable to CSRF attacks and uses a different
   authentication, requires it.

**Performance improvements:**

 * Performance of organizations query\
   Improve organization query for the table by avoiding individual
   queries.

### cereslib
  
  * Update Poetry's package dependencies

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.19.0 - (2023-12-19)

**New components:**

* grimoirelab-toolkit 0.4.1
* kidash 0.6.4
* sortinghat 0.18.0
* cereslib 0.5.1
* perceval 0.23.4
* perceval-mozilla 0.3.20
* perceval-opnfv 0.2.20
* perceval-puppet 0.2.20
* perceval-weblate 0.2.20
* graal 0.4.19
* grimoire-elk 0.109.4
* sirmordred 0.10.4

The following list describes the changes by component:

### grimoirelab-toolkit
  
  * Update Poetry's package dependencies

### kidash

**Dependencies updateds:**

 * Downgrade urllib3 from ^2.0.7 to ^1.26\
   Downgrade the version of urllib3 to match Perceval version.

### sortinghat

**New features:**

 * Link to profile in individual cards (#837)\
   The name on the individuals cards now links to the member's profile.
 * Open calendar to the side of the date input (#838)\
   The date picker calendar that is used to edit affiliation dates now
   opens to the right side of the text field to avoid covering it.
 * Improved readability of job settings\
   The options for the "unify" and "recommend matches" jobs are now
   displayed in a clearer way.
 * Improved loading time when looking for organizations\
   The autocomplete field that is used to affiliate individuals to
   organizations now makes fewer and lighter requests to find them,
   resulting in faster loading times.

**Performance improvements:**

 * Performance on affiliation recommendations improved\
   We have improved the affiliation performance by one order of magnitude
   removing unnecessary queries to the database.

### cereslib
  
  * Update Poetry's package dependencies

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.18.0 - (2023-11-28)

**New components:**

* kidash 0.6.3
* sortinghat 0.17.0
* cereslib 0.5.0
* perceval 0.23.3
* perceval-mozilla 0.3.19
* perceval-opnfv 0.2.19
* perceval-puppet 0.2.19
* perceval-weblate 0.2.19
* graal 0.4.18
* grimoire-elk 0.109.3
* sirmordred 0.10.3

The following list describes the changes by component:

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**New features:**

 * Gitdm identities importer\
   New SortingHat identities importer for Gitdm format. This backend is
   configured with three parameters: a URL pointing to the file that
   matches emails with organizations, an optional URL for an aliases file
   that associates emails, and a flag for email validation to verify the
   validity of the provided email addresses.

### cereslib

**New features:**

 * TimeZone field in Git Areas of Code\
   Include time zone field of commit date in Git Areas of Code index.

**Bug fixes:**

 * Future compatibility with Pandas method (#52)\
   Set regex parameter to True in `pandas.Series.str.replace` for future
   compatibility.

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.17.0 - (2023-11-17)

**New components:**

* sortinghat 0.16.0
* graal 0.4.17
* grimoire-elk 0.109.2
* sirmordred 0.10.2

The following list describes the changes by component:

### sortinghat

**Bug fixes:**

 * Fix individual page not loading\
   The individual's view was not loading when the workspace had not been
   used before or the cache was cleared.

**Performance improvements:**

 * Recommendations performance improved\
   Improve the recommendations performance by reducing the number of
   queries to the database and only generating recommendations between
   individuals that are directly related.

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.16.0 - (2023-11-06)

**New components:**

* kidash 0.6.1
* sortinghat 0.15.0
* perceval 0.23.1
* perceval-mozilla 0.3.17
* perceval-opnfv 0.2.17
* perceval-puppet 0.2.17
* perceval-weblate 0.2.17
* graal 0.4.15
* grimoire-elk 0.109.1
* sirmordred 0.10.1

The following list describes the changes by component:

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**New features:**

 * Recommendations for individuals modified after a given date (#813)\
   Users can generate merge and affiliation recommendations for
   individuals that have been created or modified after a date specified
   with the `last_modified` parameter.
 * Add individual to workspace from their profile page (#816)\
   A new button on the individual's profile page allows users to save the
   identity in the workspace to continue working with it later on the
   dashboard.
 * Cache individuals table data (#821)\
   Using cached queries prevents the table from refetching all the data
   from the server everytime any information is edited. This is
   particularly helpful if there is a huge number of identities, where
   reloading the table is very slow. However, there are some cases when
   the queries need to be refetched, eg. when identities are merged or
   split.

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred

**Bug fixes:**

 * Periodic autorefresh not working\
   Periodic refresh of identities was not working for backend sections
   that included `:` in their name.


## GrimoireLab 0.15.1 - (2023-10-20)

**New components:**


The following list describes the changes by component:


## GrimoireLab 0.15.0 - (2023-10-20)

**New components:**

* grimoirelab-toolkit 0.4.0
* kidash 0.6.0
* sortinghat 0.14.0
* cereslib 0.4.3
* sigils 0.3.0
* perceval 0.23.0
* perceval-mozilla 0.3.16
* perceval-opnfv 0.2.16
* perceval-puppet 0.2.16
* perceval-weblate 0.2.16
* graal 0.4.14
* grimoire-elk 0.109.0
* sirmordred 0.10.0

The following list describes the changes by component:

### grimoirelab-toolkit

**Feature removals:**

 * Drop Python 3.7 support\
   Python 3.7 reaches the end of life in June 2023. This means it won't
   receive new updates or patches to fix security issues. Therefore, this
   package only works with Python >= 3.8 from now on.

### kidash

**Feature removals:**

 * Drop Python 3.7 support\
   Python 3.7 reaches the end of life in June 2023. This means it won't
   receive new updates or patches to fix security issues. Therefore, this
   package only works with Python >= 3.8 from now on.

**Dependencies updateds:**

 * Bump urllib3 version\
   Bump urllib3 from ^1.26 to ^2.0.7

### sortinghat

**New features:**

 * Strict criteria for merge recommendations (#812)\
   The merge recommendations filter out invalid email adresses and names
   that don't have at least a first and last name  when looking for
   matches. To disable this behavior, set the `strict` parameter on
   `recommendMatches` or `unify` to `false`.
 * Text field to update enrollment dates (#819)\
   Users have the option to enter the dates on a text field when editing
   affiliations.
 * Improved organization selector (#820)\
   The organization selector that is used to affiliate individuals now
   has the option to create an organization if the desired one is not
   found. Its size is also increased to improve the readability of longer
   names.
 * API method to create a scheduled task\
   The `add_scheduled_task` API method adds a new scheduled task to the
   registry.
 * Manage app settings from the user interface\
   Users can configure automatic affiliations, profile unification and
   identity data synchronization from the new `Settings` section on the
   user interface.

**Bug fixes:**

 * Remove tasks that fail to be scheduled\
   When there was an issue with the Redis connection when a task was
   created, the task was added to the database but there was not
   scheduled job linked to it. Tasks are  now removed from the database
   and an error is raised in this case.

**Dependencies updateds:**

 * Add Python 3.9 and drop 3.7 support\
   Python 3.7 reached the end of life phase on June 27 2023 and is no
   longer supported.

### cereslib

**Dependencies updateds:**

 * Add Python 3.9 and 3.10 and drop 3.7 support\
   Python 3.7 reached the end of life phase on June 27 2023 and is no
   longer supported.

### sigils

**Feature removals:**

 * Drop Python 3.7 support\
   Python 3.7 reaches the end of life in June 2023. This means it won't
   receive new updates or patches to fix security issues. Therefore, this
   package only works with Python >= 3.8 from now on.

### perceval

**New features:**

 * Jira authentication with token (#813)\
   Authentication in `jira` backend is supported using personal access
   tokens. Jira Core/Software (8.14 and later), Jira Service Management
   (4.15 and later) Data Center and server editions can use personal
   access tokens without a username. For Jira Cloud, username and token
   are required. Usage: perceval jira <YOUR_JIRA_SERVER> -u <USERNAME> -p
   <PASSWORD> perceval jira <YOUR_JIRA_SERVER> -t <PERSONAL_ACCESS_TOKEN>
   perceval jira <YOUR_JIRA_CLOUD_SITE> -u <USERNAME> -t <TOKEN>
 * Clonfluence authentication with personal access tokens\
   Authentication in `confluence` backend is supported using personal
   access tokens. Confluence Data Center and server editions 7.9 and
   later can use personal access tokens without a username. For
   Confluence Cloud, username and token are required.

**Feature removals:**

 * Drop Python 3.7 support\
   Python 3.7 reaches the end of life in June 2023. This means it won't
   receive new updates or patches to fix security issues. Therefore, this
   package only works with Python >= 3.8 from now on.

**Dependencies updateds:**

 * Bump urllib3 version\
   Bump urllib3 from ^1.26 to ^2.0.7

### perceval-mozilla

**Dependencies updateds:**

 * Add Python 3.10 and 3.11 and drop 3.7 support\
   Python 3.7 reached the end of life phase on June 27 2023 and is no
   longer supported.

### perceval-opnfv

**Dependencies updateds:**

 * Add Python 3.10 and 3.11 and drop 3.7 support\
   Python 3.7 reached the end of life phase on June 27 2023 and is no
   longer supported.

### perceval-puppet

**Dependencies updateds:**

 * Add Python 3.10 and 3.11 and drop 3.7 support\
   Python 3.7 reached the end of life phase on June 27 2023 and is no
   longer supported.

### perceval-weblate

**Dependencies updateds:**

 * Add Python 3.10 and 3.11 and drop 3.7 support\
   Python 3.7 reached the end of life phase on June 27 2023 and is no
   longer supported.

### graal

**Dependencies updateds:**

 * Update markdown-it-py version\
   Use `markdown-it-py^2.0.0` to be aligned with Perceval packages.
 * Add Python 3.9 and drop 3.7 support\
   Python 3.7 reached the end of life phase on June 27 2023 and is no
   longer supported.

### grimoire-elk

**New features:**

 * Anonymize repository URLs in graal backend\
   The raw data generated by the graal backend had non-anonymized URLs on
   the meta fields 'origin' and 'tag'. This was necessary to generate
   enriched data for non-public repositories.
 * Bug description in Bugzilla\
   Include the description of the bugs in Bugzilla. The new fields are
   'description' and 'description_analyzed'. The second allows to query
   any of the words of the description.
 * SortingHat backend name per data source\
   Allow to define the name of the backend for the identities stored in
   SortingHat. From now on github2 is renamed as github in SortingHat
   identities.

**Bug fixes:**

 * Individual `id` incorrectly assigned\
   Correct a bug that results in enriched items using the individual ID
   as the identity ID, and vice versa.
 * Error in OpenSearch response stops demography study\
   Fix an issue that stops demography study when OpenSearch occasionally
   provides a response without some expected fields.
 * Undefined identities in GitHub comments\
   Fix a bug that causes certain identities from commentaries to not be
   imported into SortingHat, resulting in them appearing as UNDEFINED in
   OpenSearch.

**Dependencies updateds:**

 * Add Python 3.9 and 3.10 and drop 3.7 support\
   Python 3.7 reached the end of life phase on June 27 2023 and is no
   longer supported.
 * Bump urllib3 version\
   Bump urllib3 from ^1.26 to ^2.0.7
 * Remove Python pymsql dependency\
   Remove the dependency with PyMySQL because it is not used anymore.

### sirmordred

**New features:**

 * Refresh identities in a shorter period\
   This update significantly reduces the time required for identity
   refresh operations on large projects.

**Bug fixes:**

 * Missing database parameters for SortingHat\
   SortingHat database parameters were not included during the
   initialization of the enrich backend.

**Breaking changes:**

 * Log format updated with the Mordred project name\
   Update the log format of SirMordred and MicroMordred to include the
   name of the project.

**Dependencies updateds:**

 * Add Python 3.9 and 3.10 and drop 3.7 support\
   Python 3.7 reached the end of life phase on June 27 2023 and is no
   longer supported.


## GrimoireLab 0.14.0 - (2023-08-06)

**New components:**

* sortinghat 0.13.0
* perceval 0.22.3
* perceval-mozilla 0.3.15
* perceval-opnfv 0.2.15
* perceval-puppet 0.2.15
* perceval-weblate 0.2.15
* graal 0.4.13
* grimoire-elk 0.108.1
* sirmordred 0.9.3

The following list describes the changes by component:

### sortinghat

**Bug fixes:**

 * Sub-domain affiliation error (#805)\
   The `affiliate` and `recommend affiliations` jobs no longer recommend
   matches based on a domain's sub-domains if it is not marked as
   `top_domain`.

**New deprecations:**

 * Use the task scheduler to import identities\
   Manage periodic tasks to import identities with the `scheduleTask`,
   `updateScheduledTask` and `deleteScheduledTask` GraphQL mutations. The
   tasks that were already scheduled using the `addImportIdentitiesTask`
   mutation are kept when the migrations are applied.

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.13.0 - (2023-07-23)

**New components:**

* kidash 0.5.9
* sortinghat 0.12.0
* perceval 0.22.2
* perceval-mozilla 0.3.14
* perceval-opnfv 0.2.14
* perceval-puppet 0.2.14
* perceval-weblate 0.2.14
* graal 0.4.12
* grimoire-elk 0.108.0
* sirmordred 0.9.2

The following list describes the changes by component:

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**New features:**

 * Job scheduler\
   This new feature allows users to schedule jobs, such as `affiliate` or
   `unify`, to run periodically. The tasks can be configured, updated and
   deleted using the GraphQL API.

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk

**Bug fixes:**

 * Enrich items with multiple enrollments\
   The `date` field must be a string since improved performance by
   decreasing calls to the `str_to_datetime` method.

**Performance improvements:**

 * Load identities performance\
   Improve the load identities process performance by reducing the number
   of queries to SortingHat.

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.12.0 - (2023-07-11)

**New components:**

* grimoirelab-toolkit 0.3.6
* kidash 0.5.8
* sortinghat 0.11.1
* cereslib 0.4.2
* perceval 0.22.1
* perceval-mozilla 0.3.13
* perceval-opnfv 0.2.13
* perceval-puppet 0.2.13
* perceval-weblate 0.2.13
* graal 0.4.11
* grimoire-elk 0.107.0
* sirmordred 0.9.1

The following list describes the changes by component:

### grimoirelab-toolkit
  
  * Update Poetry's package dependencies

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**Bug fixes:**

 * Show an organization's members\
   Repeatedly clicking on the button to see the members of an
   organization or team on the table sometimes showed the full
   individuals list.

### cereslib
  
  * Update Poetry's package dependencies

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk

**Performance improvements:**

 * Enrichment processing time reduced by 50%\
   The general performance was improved reducing the number of calls to
   the identities manager (i.g. `SortingHat`). There were some deprecated
   calls that weren't needed any longer and also, we increased the cache
   of individuals in ELKs. We were also able to reduce the processing
   time of the Git backend by converting commit dates only once.

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.11.0 - (2023-06-28)

**New components:**

* sortinghat 0.11.0
* cereslib 0.4.1
* perceval 0.22.0
* perceval-mozilla 0.3.12
* perceval-opnfv 0.2.12
* perceval-puppet 0.2.12
* perceval-weblate 0.2.12
* graal 0.4.10
* grimoire-elk 0.106.0
* sirmordred 0.9.0

The following list describes the changes by component:

### sortinghat

**New features:**

 * Merge organizations (#571)\
   Merging organizations automatically moves all the domains, teams and
   enrollments to the target organization. This is helpful in case an
   organization has duplicates or if an organization absorbs another one.
   Organizations can be merged using drag and drop on the user interface.
 * Recommendations by individual (#779)\
   Users can generate matching recommendations for a specific individual
   by clicking on the drop down menu on each individual or on the
   individual's profile.

**Bug fixes:**

 * Show hidden buttons when the mouse is over the table row (#787)\
   The buttons to lock an individual or mark it as a bot were only
   visible when the mouse wass over the individual's name, which made it
   hard to find them. Now they appear when the mouse is over the table
   row.
 * Email affiliation error (#793)\
   Fix an error when the email domain ends with a dot, causing the
   affiliation process to stop.
 * ADD button doesn't affiliate individuals to organizations\
   Affiliating an individual to an organization using the "+ ADD" button
   on the table expanded view failed.
 * Enrollment filter on organizations view\
   Filtering individuals by their affiliation to an organization also
   returned results of organizations that contained that name. The filter
   now only returns organizations that match the exact name.

### cereslib
  
  * Update Poetry's package dependencies

### perceval

**New features:**

 * Git backend alternates mechanism\
   Git alternates is a mechanism that lets a repository borrow objects
   from another repository on the same machine.  Allow to execute Git
   Perceval backend using this mechanism.

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk

**Performance improvements:**

 * Refreshing identities performance\
   Decrease the time required to execute the autorefresh process by
   reducing the number of queries to SortingHat.

### sirmordred

**Performance improvements:**

 * Refreshing identities performance\
   Decrease the time required to execute the autorefresh process by
   reducing the number of queries to SortingHat.


## GrimoireLab 0.10.0 - (2023-05-17)

**New components:**

* kidash 0.5.6
* sortinghat 0.10.0
* perceval 0.21.7
* perceval-mozilla 0.3.11
* perceval-opnfv 0.2.11
* perceval-puppet 0.2.11
* perceval-weblate 0.2.11
* graal 0.4.9
* grimoire-elk 0.105.0
* sirmordred 0.8.0

The following list describes the changes by component:

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**New features:**

 * Show when tables are loading (#772)\
   The individuals and organizations tables now show a progress bar to
   indicate that the items are loading.
 * Organization profiles\
   Each organization's full profile is available by clicking its name on
   the table or at `/organization/<organization name>`. This view shows
   the organization's teams, members and domains.

**Bug fixes:**

 * Sort jobs from newest to oldest (#769)\
   The jobs page now sorts the list from newest to oldest to show running
   jobs first.
 * Unreadable large numbers in pagination (#770)\
   Large page numbers were not fully visible in the tables pagination.
 * Edit a profile name with the pencil button (#773)\
   Clicking on an invidual's name no longer activates the edition mode.
   The name can now be edited with the pencil button.
 * Fix enrollment in individual's profile\
   In the individual's profile, the button to add an organization was not
   working.
 * Job timeouts\
   Jobs failed because they exceeded the default timeout while running
   tasks involving numerous identities. To ensure successful completion,
   we adjusted the timeout setting to an infinite duration, allowing jobs
   to finish without interruptions.

**Breaking changes:**

 * Multi-tenancy using headers\
   Tenants are now selected using the `sortinghat-tenant` header instead
   of the host. Proxies and clients using multi-tenancy should include
   that header.

**Performance improvements:**

 * Performance improved for recommendations and merging jobs\
   The performance of the matching and merging algorithms that are used
   on these jobs have been considerably improved. These jobs will be 4
   times faster than on the previous version.
 * uWSGI threads and workers\
   Include two new environments variables to define the number of threads
   and workers for uWSGI. These new variables are
   `SORTINGHAT_UWSGI_WORKERS` and `SORTINGHAT_UWSGI_THREADS`
 * SortingHat database performance\
   Improve SortingHat performance when there are a lot of individuals in
   the database.

**Dependencies updateds:**

 * Update dependencies\
   Include google-auth as a dependency to fix release issues.

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk

**Breaking changes:**

 * SortingHat configuration\
   When SortingHat's multi-tenancy is enabled, the tenant is included in
   all clients during execution.

### sirmordred

**New features:**

 * Optional configuration for SortingHat\
   Include an optional configuration for SortingHat to define the name of
   the tenant when multi-tenancy is enabled.

**Bug fixes:**

 * Race condition initializing SirMordred\
   There was a race condition when SirMordred initializes. The thread
   that read the list of projects didn't have time to even start before
   the manager finalizes it, so data backends didn't have any have any
   input to work with. This bug was originally reported by ncsibra-lab49
   on
   [grimoirelab#585](https://github.com/chaoss/grimoirelab/issues/585).


## GrimoireLab 0.9.2 - (2023-04-28)

**New components:**

* sortinghat 0.9.3
* graal 0.4.8
* grimoire-elk 0.104.6
* sirmordred 0.7.2

The following list describes the changes by component:

### sortinghat

**Bug fixes:**

 * Tenant selection in job fixed\
   Tenant selection raised an error when the job context was defined as
   keyword argument.

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.9.1 - (2023-04-27)

**New components:**

* kidash 0.5.5
* sortinghat 0.9.2
* perceval 0.21.6
* perceval-mozilla 0.3.10
* perceval-opnfv 0.2.10
* perceval-puppet 0.2.10
* perceval-weblate 0.2.10
* graal 0.4.7
* grimoire-elk 0.104.5
* sirmordred 0.7.1

The following list describes the changes by component:

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**Bug fixes:**

 * Static files not included in wheel package\
   SortingHat static files were not included in the Python package. The
   problem was in the GitHub action.

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.9.0 - (2023-04-21)

**New components:**

* grimoirelab-toolkit 0.3.4
* kidash 0.5.4
* sortinghat 0.9.0
* cereslib 0.4.0
* perceval 0.21.4
* perceval-mozilla 0.3.8
* perceval-opnfv 0.2.8
* perceval-puppet 0.2.8
* perceval-weblate 0.2.8
* graal 0.4.5
* grimoire-elk 0.104.3
* sirmordred 0.7.0

The following list describes the changes by component:

### grimoirelab-toolkit
  
  * Update Poetry's package dependencies

### kidash
  
  * Update Poetry's package dependencies

### sortinghat

**New features:**

 * Set top domain from UI (#729)\
   Add the option to set an organization's domain as top domain from the
   UI.
 * Order individuals by indentities (#732)\
   Adds the option to order the individuals by the number of identities
   they have.
 * Import identities automatically (#746)\
   Create a schema to import identities to SortingHat automatically using
   custom backends. The jobs will be executed periodically, at the given
   interval.  The tasks can be configured using the GraphQL API.  To
   create a custom importer you need to extend `IdentitiesImporter`,
   define a `NAME` for your importer (that will be used in the UI), and
   implement `get_identities` method that returns a list of individuals
   with the related identities that will be imported into SortingHat. If
   your importer requires extra parameters, you must extend the
   `__init__` method with the required parameters. Those parameters can
   be defined using the API.
 * Create account command\
   Include a new command to create users in SortingHat. The command can
   be executed as `sortinghat-admin create-user`.
 * Drag and drop to enroll in teams\
   Expanding an organization on the table now shows the full list of
   teams. Individuals can be dragged and dropped into a team and
   viceversa to affiliate them. The buttons to add, edit and delete
   organization and team information are reorganized into a dropdown menu
   to simplify the interface.
 * Multi-tenancy mode\
   SortingHat allows hosting multiple instances with a single service
   having each instance's data isolated in different databases. To enable
   this feature follow these guidelines: - Set `MULTI_TENANT` settings to
   `True`. - Define the tenants in `sortinghat/config/tenants.json`. -
   Assign users to tenants with `sortinghat-admin set-user-tenant`
   command.
 * Verify SSL option for client\
   Include an option for the client to verify if the certificate is
   valid. By default it is verified.

**Bug fixes:**

 * Fix outdated recommendation count (#733)\
   The number of remaining recommendations on the UI was wrong each time
   a recommendation was applied or dismissed.
 * Fix search syntax link (#735)\
   Fixes the link to the search syntax page on the search bar.

**Feature removals:**

 * Groups table removed from the UI\
   Groups and organizations are very similar, and having both tables in
   the dashboard can be confusing to users. To simplify the view, the
   table is removed from the user interface, but groups remain available
   through the API.

### cereslib

**New features:**

 * Support for more languages and file types\
   The library is able to detect the new file formats and language
   formats. This list includes JavaScript, TypeScript, Terraform, among
   others.

### perceval

**Bug fixes:**

 * Default value for mbox to-date (#810)\
   Include a default value for `--to-date` argument in mbox backend.

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal

**Dependencies updateds:**

 * Update package dependencies\
   Update package dependencies and pin `markdown-it-py` to a specific
   version.

### grimoire-elk

**Bug fixes:**

 * Fix typo in SortingHat fields\
   Some fields were not updated from the old version of SortingHat. Now
   the API returns 'isBot' and 'genderAcc' instead of 'is_bot' and
   'gender_acc'.

**Breaking changes:**

 * Define date format for Git documents\
   Git by default uses a custom date format that is not recognized by
   Elastic/OpenSearch.  Specify the format for the AuthorDate and
   CommitDate fields in Git documents to support the formats usually
   returned by `git log`.  This allows us to do proper filtering on these
   fields such as "all documents with CommitDate before 2020".
 * Update support for ES/OS versions > 7.X/1.X\
   Currently the support for ES/OS versions > 7.X/1.X is broken due to a
   faulty version check.  Add a static method to the Elasticsearch object
   that correctly checks whether the version is 'legacy' (defined as ES
   6.X or OS 0.X) and adds this check to various places in the codebase.
   Additionally, fixes an instance where `interval` is used instead of
   `fixed_interval`. `interval` was deprecated in ES7.

### sirmordred

**New features:**

 * SirMordred logs available on console\
   All SirMordred logs are now available on the console output. The
   `logs_dir` parameter in the `general` section is optional and it is
   only needed if you also want the logs in a file.
 * SortingHat option to verify SSL\
   Include `verify_ssl` option to SortingHat configuration to verify the
   connection with the server. By default it is `True`.


## GrimoireLab 0.8.0 - (2023-02-03)

**New components:**


The following list describes the changes by component:


## GrimoireLab 0.7.4 - (2023-02-03)

**New components:**

* sortinghat 0.8.1
* perceval 0.21.3
* perceval-mozilla 0.3.7
* perceval-opnfv 0.2.7
* perceval-puppet 0.2.7
* perceval-weblate 0.2.7
* graal 0.4.4
* grimoire-elk 0.104.2
* sirmordred 0.6.1

The following list describes the changes by component:

### sortinghat
  
  * Update Poetry's package dependencies

### perceval
  
  * Update Poetry's package dependencies

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.7.3 - (2023-02-01)

**New components:**

* grimoire-elk 0.104.1
* sirmordred 0.6.0

The following list describes the changes by component:

### grimoire-elk
  
  * Update Poetry's package dependencies

### sirmordred

**Bug fixes:**

 * SortingHat mandatory parameters\
   Include SortingHat 0.8.x mandatory parameters. Now `sh_port`,
   `sh_path`, `sh_ssl` are available to configure SortingHat.

**Breaking changes:**

 * Support of SortingHat 0.8\
   GrimoireLab starts using a new version of SortingHat.  SortingHat is
   now a web service that provides an API to manage identities and
   organizations. SirMordred now connects to the new SortingHat database
   using GraphQL.  The previous version of SortingHat is now deprecated.


## GrimoireLab 0.7.1 - (2022-11-07)

**New components:**

* sortinghat 0.7.23
* cereslib 0.3.5
* perceval 0.21.1
* perceval-mozilla 0.3.5
* perceval-opnfv 0.2.5
* perceval-puppet 0.2.5
* perceval-weblate 0.2.5
* kingarthur 0.2.5
* graal 0.4.2
* grimoire-elk 0.103.3
* sirmordred 0.5.1

The following list describes the changes by component:

### sortinghat
  
  * Update Poetry's package dependencies

### cereslib
  
  * Update Poetry's package dependencies

### perceval

**Bug fixes:**

 * Mbox to-date argument fixed\
   It fixes the `--to-date` argument. This parameter was added to fetch
   data until a specific date.

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### kingarthur
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk

**Bug fixes:**

 * Demographic study on Weblate fixed\
   Weblate demographic study is now updated to allow passing the study
   alias name by parameter.

### sirmordred
  
  * Update Poetry's package dependencies


## GrimoireLab 0.7.0 - (2022-10-31)

**New components:**

* grimoirelab-toolkit 0.3.2
* kidash 0.5.2
* sortinghat 0.7.22
* cereslib 0.3.4
* perceval 0.21.0
* perceval-mozilla 0.3.4
* perceval-opnfv 0.2.4
* perceval-puppet 0.2.4
* perceval-weblate 0.2.4
* kingarthur 0.2.4
* graal 0.4.1
* grimoire-elk 0.103.2
* sirmordred 0.5.0

The following list describes the changes by component:

### grimoirelab-toolkit
  
  * Update Poetry's package dependencies

### kidash
  
  * Update Poetry's package dependencies

### sortinghat
  
  * Update Poetry's package dependencies

### cereslib
  
  * Update Poetry's package dependencies

### perceval

**New features:**

 * [gitlab] Alias `--url` for `--enterprise-url` argument (#801)\
   The argument `--enterprise-url` for Gitlab backend has the new alias
   `--url`. With this argument, users can define the GitLab instance from
   items will be fetched. This can be set to the SaaS GitLab
   (`gitlab.com`) or to a self-managed instance (e.g.
   `gitlab.example.com`). By default, this parameter points to
   `https://gitlab.com`.
 * [hyperkitty/mbox] Option `to-date` to fetch until that date\
   This parameter allows fetching data until a specific date. By default,
   this value is `2100-01-01`, but this can be changed adding `--to-
   date`.

### perceval-mozilla
  
  * Update Poetry's package dependencies

### perceval-opnfv
  
  * Update Poetry's package dependencies

### perceval-puppet
  
  * Update Poetry's package dependencies

### perceval-weblate
  
  * Update Poetry's package dependencies

### kingarthur
  
  * Update Poetry's package dependencies

### graal
  
  * Update Poetry's package dependencies

### grimoire-elk

**New features:**

 * Development and reviewing contributors fields for Git items\
   New information about the participants during the development and the
   reviewing processes are available in `Git` items. The Git backend
   extracts these data from `Approved-by`, `Co-authored-by`,  and
   `Merged-by` trailers that some commit messages might include. For each
   one of these trailers, new fields will be available with the suffixes:
   `_bots`, `_domains`, `_names`, `_org_names`, and `_uuids`. Also for
   each one of these suffixes, there will be extra fields with the prefix
   `non_authored_`. This is an example of the fields available for the
   the trailer `Merged-by`:     - merged_by_multi_bots     -
   merged_by_multi_domains     - merged_by_multi_names     -
   merged_by_multi_org_names     - merged_by_multi_uuids     -
   non_authored_merged_by_multi_bots     -
   non_authored_merged_by_multi_domains     -
   non_authored_merged_by_multi_names     -
   non_authored_merged_by_multi_org_names
 * Option 'to-date' on the backend sections\
   The option `to-date` on the `setup.cfg` allows fetching data until a
   specific date. By default, this value is `2100-01-01`.

**Bug fixes:**

 * Onion study on Github pull requests fixed\
   Github pull requests onion study is now updated to allow passing the
   study alias name by parameter.
 * Onion study on Gitlab fixed\
   Gitlab onion study is now updated to allow passing the study alias
   name by parameter.

**Dependencies updateds:**

 * New Pandas version\
   Update Pandas to the newest version compatible with Python 3.7+.

### sirmordred

**New features:**

 * New default GitHub pull requests alias names\
   GitHub pull_request category (github:pull) has its own aliases now:
   `github_pull_requests` and `github_pull_requests-raw`. This category
   used to share the default aliases for GitHub: `github` and `github-
   raw`.


## GrimoireLab 0.4.0 - (2022-06-29)

**New components:**

 * grimoirelab-toolkit 0.3.1
 * perceval 0.19.1
 * perceval-mozilla 0.3.1
 * perceval-puppet 0.2.1
 * perceval-opnfv 0.2.1
 * perceval-weblate 0.2.1
 * kingarthur 0.3.1
 * graal 0.3.1
 * elk 0.102.0
 * sirmordred 0.3.1

### Perceval

**New features:**

 * [confluence] Option `max_contents` to limit the number of requested contents\
   This parameter sets the maximum number of contents requested per
   query. By default, this number is 200, but this can be changed by
   adding the `--max-contents` argument. This will help to bypass those
   instances where the maximum limit is lower than Perceval's default
   value.

**Bug fixes:**

 * [confluence] KeyError exception when arguments not passed to 'fetch_items'\
   Required arguments that weren't passed to 'fetch_items' made the code
   fail with a KeyError exception.
 * [bugzillarest] Failback when checking custom instances\
   Some Bugzilla instances return a HTTP 400 error when checking if their
   are custom instances or not. On those cases, the backend will capture
   the error and consider the version of that Bugzilla instance as
   custom.
 * [slack] Slack identifier extraction fixed\
   Extract the identifier without user information when the user was
   deleted.

## GrimoireLab 0.3.0 - (2022-06-07)

**Feature removals:**

 * Drop Python 3.6 support\
   Python 3.6 has reached the end of life in Dec 2021. This means it
   won't receive any further patches to fix the secutiry issues. So,
   dropping the support of 3.6 and it now supports Python>=3.7 version
   only.

**New components:**

 * grimoirelab-toolkit 0.3.0
 * perceval 0.18.0
 * perceval-mozilla 0.3.0
 * perceval-opnfv 0.2.0
 * perceval-puppet 0.2.0
 * perceval-weblate 0.2.0
 * graal 0.3.0
 * kingarthur 0.2.0
 * sortinghat 0.7.20
 * cereslib 0.3.0
 * grimoire-elk 0.101.1
 * sigils 0.1.0
 * sirmordred 0.3.0
 * kidash 0.5.0

The following list describes the changes by component:

### Perceval

**New features:**

 * [bugzillarest] API Key authentication\
   A new authentication is available in the `bugzillarest` backend using
   an API Key. This can be provided using the parameter `--api-key` on
   the command line. Note that this parameter will invalidate `--backend-
   user` `--backend-password`, and `--api-token` parameters. For
   developers, this parameter is also available during the initialization
   of the class `BugzillaRESTClient` under the name `api_key`.
 * Confluence supports fetch by spaces\
   This allows fetching confluence by specific spaces. By default it will
   fetch the entire instance, but adding the `--spaces` argument will
   fetch only these spaces.

### Graal

**Bug fixes:**

 * Fix error in update worktree\
   Graal wasn't working with the latest version of Git 2.35.1 because it
   protects braches checked out in all worktrees. This change renames the
   branch created when creating a worktree to fix the issue.
   
### Sorting Hat

**Bug fixes:**

 * [gitdm] Skip invalid format lines\
   Gitdm parser won't fail reading files with an invalid format. Instead,
   it will ignore invalid content.

### GrimoireELK

**New features:**

 * Anonymize parameters\
   A new API function `anonymize_params(params)` allows to anonymize a
   list of parameters that developers might consider secrets. It will
   only take effect for those parameters which their names are defined on
   `SECRET_PARAMETERS` constant.
 * Dependencies file for development\
   Include a new requirements.txt file to install the development version
   from the repositories.
 * Support to add identities to SortingHat from Enrich class\
   New methods `add_identities` and `add_identity` are available on
   `Enrich` class to add new identities to a `SortingHat` database.
   Libraries using `elk` won't need to use `sortinghat` library to store
   new identities while enriching items.
 * Collect and enrich confluence by spaces\
   Users can collect and enrich Confluence data from specific spaces
   only, adding the option `--spaces=[SPACE1, SPACE2, ...]` to their
   `projects.json`. The following example shows how to collect and to
   enrich data from only the `DEV` and `SUPP` spaces only. ``` {
   "project": {         "confluence": [             "http://example.com
   --spaces=[DEV, SUPP]"         ]     } } ```
 * Add demographic study to mattermost\
   Add the demographic study to the mattermost data source.

**Bug fixes:**

 * Skip sources with wrong arguments\
   Sources won't interrupt collection or enrichment processes when any of
   their arguments are invalid. Instead, they will be skipped.
 * Git fix 'is_git_commit_multi_author'\
   This fixes the `is_git_commit_multi_author` field when the commit has
   more than one author and `pair-programming` is enabled. This is
   important for calculating `pair_programming_*` values.
 * SortingHat as a required package\
   SortingHat is required for running grimoireelk but it was set as an
   extra dependency. From now on sortinghat is always installed with
   grimoireelk.
 * Confluence credentials not stored in raw indexes\
   Credentials for Confluence datasource were stored in raw indices as
   part of the URL. For now on, credentials that are part of URLs are
   removed before any data is stored.
 * Pair programming regular expression improvement\
   The regular expression to detect pair programming authors in git
   datasource has been improved adding more connectors. The following
   list shows the current connectors: - `[aA][nN][dD]` - `&` - `+`
 * Fix fetching authors with min and max dates\
   The old query only returns 10000 items due to ElasticSearch and
   OpenSearch now use `composite` aggregation to paginate all buckets.

### Sir Mordred

**New features:**

 * Add extract spaces\
   Extract spaces from the URL. By default it will extract labels but
   adding `tag_type="spaces"` it will extract spaces.

**Bug fixes:**

 * Studies aliases relocated\
   Relocate studies aliases so they are not created automatically by
   Mordred.
 * Add pair-programming in '_get_enrich_backend' method\
   Add the `pair-programming` to the `_get_enrich_backend` method if it
   exists in the setup.cfg file.

**Feature removals:**

 * FINOS Meeting backend removed\
   FINOS Meeting backend is not supported anymore. The Perceval backend
   was archived in Bitergia repository so it shouldn't be part of the
   core anymore because it's software not maintained.

**Others:**

 * Add studies to the alias file\
   Add onion, areas of code, and demographics studies to the file
   aliases.json. This is needed to keep this file updated with the
   aliases we use in the dashboards by adding them to the appropiate data
   sources. The included aliases: - all_onion - git_areas_of_code -
   demographics