Descriptions des nouvelles fonctionnalités
Fin de vie de Python2 et RHEL 7
OpenSource Data Platform (ODP) 1.2.4.0 ne supporte plus Python2 et RedHat 7. Les versions construites pour RedHat7 / Python2 peuvent être demandées à l'équipe de support. Pour les scénarios de mise à niveau, veuillez vous référer au [Guide de mise à niveau](/docs/1.2.4.0/upgrade/upgrade-introduction)
Changement de comportement
Apache Ozone et Kerberos
Pour activer la haute disponibilité d'apache Ozone sur SCM dans un cluster kerberisé, vous devez le faire lors de l'installation initiale.
Apache Ozone supporte désormais la haute disponibilité sur l'installation pour SCM et OM. Cependant, la haute disponibilité n'est pas activée par défaut. Si vous souhaitez activer la haute disponibilité d'Ozone SCM sur un cluster kerberisé, vous devez le faire lors de l'installation initiale. Vous pouvez demander de l'aide à l'équipe de support.
Changement de versions des composants
Upgrade majeure de la distribution
- Upgrade ** Apache Spark ** 3 vers la version 3.5.1
- Upgrade ** Apache Nifi ** vers la version 1.24.0
- Upgrade ** Apache Tez ** vers la version 0.10.2
- Upgrade ** Apache Kafka ** vers la version 3.6.2
- Upgrade ** Apache Solr ** vers la version 8.11.4
Apache Ambari
| Issue Type | Key | Summary |
|---|---|---|
| Sub-task | AMBARI-210 | update contrib views utils to use commons-lang3 |
| Sub-task | AMBARI-209 | update hadoop dependency to 3.3.x in contrib views utils |
| Sub-task | AMBARI-208 | add commons-lang to ambari-view-utils |
| Sub-task | AMBARI-207 | update mvn-rpm-plugin in ambari-views-package |
| Sub-task | AMBARI-206 | add commons-lang to ambari-view-utils |
| Bug | AMBARI-205 | fix big file upload with curl when upload hbase.tar.gz |
| Bug | AMBARI-204 | update hadoop version to ODP 1.2.2.0 in ambari-metrics |
| Task | AMBARI-203 | AMBARI-25988: Fix outdated ember-collection dependency |
| Task | AMBARI-202 | Port AMBARI-25989: Remove not supported modules from views |
| Bug | AMBARI-201 | Fix missing hue_host_name in hue Service check when installing |
| Bug | AMBARI-200 | set default value for Zeppelin and HBase Rest/Thrift services |
| Improvement | AMBARI-199 | Increase HDFS NN heap default size to 2G min |
| Improvement | AMBARI-198 | Ranger compatibility between Ambari Python3 and ODP python2 |
| Improvement | AMBARI-197 | fix odp native package breaking odp stack isolation |
| Bug | AMBARI-196 | Create hive.zookeeper.log.level property in hive-env to support logback |
| Sub-task | AMBARI-195 | add Zookeeper logback in Ambari Infra Solr |
| Sub-task | AMBARI-194 | Create tools-log4j in Atlas when Kafka is not hosted on the same host |
| Sub-task | AMBARI-193 | add Zookeeper logback in Ambari Infra Solr |
| Bug | AMBARI-192 | improve kafka ranger plugin management in atlas setup |
| Sub-task | AMBARI-191 | update atlas-application properties in hbase and hive bridge to disable producer idempotence |
| Sub-task | AMBARI-190 | parametrize principal name for atas, hive, hbase, flink, Spark3, Zeppelin |
| Task | AMBARI-189 | Fix Atlas Xmn Memory Suggestion when installed from the UI on stack advisor |
| Bug | AMBARI-188 | update Atlas Kafka ACL script by removing zookeeper reference to it |
| Sub-task | AMBARI-187 | Authorize Atlas service to access Kafka notification with Ranger Kafka Plugin policies |
| Task | AMBARI-186 | improve hbase thrift site mgmt |
| Task | AMBARI-185 | add zookeeper jaas QuorumLearner and QuorumServer section |
| Task | AMBARI-184 | improve httpfs-site params management |
| Task | AMBARI-183 | update solr version to 8.11.4 for CVE fixes |
| Task | AMBARI-182 | parametrize zookeeper principal name |
| Task | AMBARI-181 | Disable Thrift hbase action when no hbase thrift server is installed |
| Task | AMBARI-180 | Fix Hue params issues when hbase and/or hdfs is not installed |
| Bug | AMBARI-179 | Add Ozone RECON UI HTTP Kerberos support |
| Task | AMBARI-177 | Add Knox Gateway Log4j2 Logback support |
| Task | AMBARI-176 | Use Apache Ozone core site when HDFS is not installed for Ranger |
| Task | AMBARI-175 | Improvate Kerberos and Ranger Handling on Apache Ozone |
| Task | AMBARI-174 | Update Ozone SCM and OME High Availability for ODP 1.2.4.0 and Ambari 2.7.11.0 |
| Bug | AMBARI-173 | Ambari-metrics: Remove specific OS package on redhat8 families |
| Task | AMBARI-172 | Fix Ozone service advisor to allow High Availability on install |
| Task | AMBARI-170 | LOGSEARCH: exclude curator-framework from hadoop-auth conflicting version |
| Task | AMBARI-169 | add trash deletion in Ozone ambari smoke check |
| Bug | AMBARI-168 | Follow up on AMBARI-26107: Migrate away from DOMNodeInserted to MutationObserver |
| Bug | AMBARI-166 | Ozone SSL-related properties arg fix in credential setup |
| Task | AMBARI-160 | Setup default logfeeder solr cloud mode to default |
| Task | AMBARI-159 | Harmonize Tez recommendations with G1GC |
| Task | AMBARI-158 | Ambari Atlas setup_credential_file typo fix |
| Task | AMBARI-157 | Ambari Infra Solr Rule Infra-Based plugin fails with multiple shards |
| Task | AMBARI-156 | ambari Logsearch support for rhel 9 families and python3 |
| Task | AMBARI-155 | Ambari Logsearch Feeder fails on start because of conflicting jars |
| Task | AMBARI-154 | Change Ambari Infra Solr security.json rendering to allow multiple shard and multiple logfeeder ranger admin to read collections |
| Task | AMBARI-153 | Backport AMBARI-25992: logsearch-portal cannot startup due to spring-boot-autoconfigure upgrade |
| Task | AMBARI-152 | Ambari Logsearch fails on start because of conflicting jetty version |
| Task | AMBARI-151 | Silence zookeeper client logs with logback.xml rendering |
| Bug | AMBARI-150 | Harmonize RedHat support family with Rocky Linux and AlmaLinux |
| Bug | AMBARI-149 | Setup credential file option force need to pass |
| Bug | AMBARI-148 | Ambari-agent restarts kill HDFS child process on Ubuntu |
Distribution ODP
| Issue Type | Key | Summary |
|---|---|---|
| Improvement | ODP-255 | LIVY: Fix knox webui redirect by propagating context |
| Improvement | ODP-254 | Port ATLAS-4817 : Change compression from 'GZ' to 'SNAPPY' in Atlas HBase tables |
| Task | ODP-253 | ATLAS-4572: Improved Soft Delete behaviour for relationships edges |
| Task | ODP-252 | Fix rendering of odp.version in hbase odp binary |
| Task | ODP-251 | Port HIVE-19138 for fixing Query Cache Result |
| Improvement | ODP-247 | Make Ranger setup db compatible with Python2 and Python3 |
| Epic | ODP-246 | Python2 to Python3 upgrade |
| Improvement | ODP-245 | Update Zeppelin to support ODP built Flink and Hadoop 3.3.6 |
| Improvement | ODP-244 | Update Spark 3 version to 3.5.1 |
| Improvement | ODP-240 | memleak Backport HIVE-24590-branch-3.1 |
| Improvement | ODP-239 | memleak Backport HIVE-26530-branch-3.1 - HS2 OOM-OperationManager.queryIdOperation cleanup |
| Improvement | ODP-238 | memleak Backport HIVE-26404-branch-3.1 |
| Improvement | ODP-237 | memleak Backport HIVE-24552-branch-3.1 |
| Task | ODP-236 | memleak Backport HIVE-24236-branch-3.1 |
| Task | ODP-235 | memleak Backport HIVE-16455-HIVE-24858-branch-3.1 |
| Task | ODP-234 | Update Jersey version to be compatible with Hadoop 3.3.6 (part of HIVE-27535) |
| Bug | ODP-226 | RANGER-3809: Implement authorizeByResourceType method of Kafka Authorizer |
| Bug | ODP-225 | RANGER-3231: Ranger should use Kafka Authorizer from KIP-504 |