Descriptions of New Features
Python2 and Rhel 7 EOL
OpenSource Data Platform (ODP) 1.2.4.0 dropped support of python2 and RedHat 7. Rehdat7 / Python2 built can be requested from the support team. For upgrade scenarios, please refer to the [Upgrade Guide](/docs/1.2.4.0/upgrade/upgrade-introduction)
Behavioral Changes
Apache Ozone and Kerberos
To enable apache Ozone High Availability on SCM in a kerberized cluster, you need to do it on the initial install.
Apache Ozone does now support High Availability on install for SCM and OM.
However High Availability is not enabled by default. And if you want to enable Ozone SCM HA on a kerberized cluster, you need to do it on the initial install.
you can request help from the support team.
Version Upgrade
Minor upgrade of Stack components version
- Upgrade ** Apache Spark ** 3 version to 3.5.1
- Upgrade ** Apache Nifi ** version to 1.24.0
- Upgrade ** Apache Tez ** version to 0.10.2
- Upgrade ** Apache Kafka ** version to 3.6.2
Fixed Issues
Apache Ambari
| Issue Type | Key | Summary |
|---|---|---|
| Sub-task | AMBARI-210 | update contrib views utils to use commons-lang3 |
| Sub-task | AMBARI-209 | update hadoop dependency to 3.3.x in contrib views utils |
| Sub-task | AMBARI-208 | add commons-lang to ambari-view-utils |
| Sub-task | AMBARI-207 | update mvn-rpm-plugin in ambari-views-package |
| Sub-task | AMBARI-206 | add commons-lang to ambari-view-utils |
| Bug | AMBARI-205 | fix big file upload with curl when upload hbase.tar.gz |
| Bug | AMBARI-204 | update hadoop version to ODP 1.2.2.0 in ambari-metrics |
| Task | AMBARI-203 | AMBARI-25988: Fix outdated ember-collection dependency |
| Task | AMBARI-202 | Port AMBARI-25989: Remove not supported modules from views |
| Bug | AMBARI-201 | Fix missing hue_host_name in hue Service check when installing |
| Bug | AMBARI-200 | set default value for Zeppelin and HBase Rest/Thrift services |
| Improvement | AMBARI-199 | Increase HDFS NN heap default size to 2G min |
| Improvement | AMBARI-198 | Ranger compatibility between Ambari Python3 and ODP python2 |
| Improvement | AMBARI-197 | fix odp native package breaking odp stack isolation |
| Bug | AMBARI-196 | Create hive.zookeeper.log.level property in hive-env to support logback |
| Sub-task | AMBARI-195 | add Zookeeper logback in Ambari Infra Solr |
| Sub-task | AMBARI-194 | Create tools-log4j in Atlas when Kafka is not hosted on the same host |
| Sub-task | AMBARI-193 | add Zookeeper logback in Ambari Infra Solr |
| Bug | AMBARI-192 | improve kafka ranger plugin management in atlas setup |
| Sub-task | AMBARI-191 | update atlas-application properties in hbase and hive bridge to disable producer idempotence |
| Sub-task | AMBARI-190 | parametrize principal name for atas, hive, hbase, flink, Spark3, Zeppelin |
| Task | AMBARI-189 | Fix Atlas Xmn Memory Suggestion when installed from the UI on stack advisor |
| Bug | AMBARI-188 | update Atlas Kafka ACL script by removing zookeeper reference to it |
| Sub-task | AMBARI-187 | Authorize Atlas service to access Kafka notification with Ranger Kafka Plugin policies |
| Task | AMBARI-186 | improve hbase thrift site mgmt |
| Task | AMBARI-185 | add zookeeper jaas QuorumLearner and QuorumServer section |
| Task | AMBARI-184 | improve httpfs-site params management |
| Task | AMBARI-183 | update solr version to 8.11.4 for CVE fixes |
| Task | AMBARI-182 | parametrize zookeeper principal name |
| Task | AMBARI-181 | Disable Thrift hbase action when no hbase thrift server is installed |
| Task | AMBARI-180 | Fix Hue params issues when hbase and/or hdfs is not installed |
| Bug | AMBARI-179 | Add Ozone RECON UI HTTP Kerberos support |
| Task | AMBARI-177 | Add Knox Gateway Log4j2 Logback support |
| Task | AMBARI-176 | Use Apache Ozone core site when HDFS is not installed for Ranger |
| Task | AMBARI-175 | Improvate Kerberos and Ranger Handling on Apache Ozone |
| Task | AMBARI-174 | Update Ozone SCM and OME High Availability for ODP 1.2.4.0 and Ambari 2.7.11.0 |
| Bug | AMBARI-173 | Ambari-metrics: Remove specific OS package on redhat8 families |
| Task | AMBARI-172 | Fix Ozone service advisor to allow High Availability on install |
| Task | AMBARI-170 | LOGSEARCH: exclude curator-framework from hadoop-auth conflicting version |
| Task | AMBARI-169 | add trash deletion in Ozone ambari smoke check |
| Bug | AMBARI-168 | Follow up on AMBARI-26107: Migrate away from DOMNodeInserted to MutationObserver |
| Bug | AMBARI-166 | Ozone SSL-related properties arg fix in credential setup |
| Task | AMBARI-160 | Setup default logfeeder solr cloud mode to default |
| Task | AMBARI-159 | Harmonize Tez recommendations with G1GC |
| Task | AMBARI-158 | Ambari Atlas setup_credential_file typo fix |
| Task | AMBARI-157 | Ambari Infra Solr Rule Infra-Based plugin fails with multiple shards |
| Task | AMBARI-156 | ambari Logsearch support for rhel 9 families and python3 |
| Task | AMBARI-155 | Ambari Logsearch Feeder fails on start because of conflicting jars |
| Task | AMBARI-154 | Change Ambari Infra Solr security.json rendering to allow multiple shard and multiple logfeeder ranger admin to read collections |
| Task | AMBARI-153 | Backport AMBARI-25992: logsearch-portal cannot startup due to spring-boot-autoconfigure upgrade |
| Task | AMBARI-152 | Ambari Logsearch fails on start because of conflicting jetty version |
| Task | AMBARI-151 | Silence zookeeper client logs with logback.xml rendering |
| Bug | AMBARI-150 | Harmonize RedHat support family with Rocky Linux and AlmaLinux |
| Bug | AMBARI-149 | Setup credential file option force need to pass |
| Bug | AMBARI-148 | Ambari-agent restarts kill HDFS child process on Ubuntu |
ODP Stack
| Issue Type | Key | Summary |
|---|---|---|
| Improvement | ODP-255 | LIVY: Fix knox webui redirect by propagating context |
| Improvement | ODP-254 | Port ATLAS-4817 : Change compression from 'GZ' to 'SNAPPY' in Atlas HBase tables |
| Task | ODP-253 | ATLAS-4572: Improved Soft Delete behaviour for relationships edges |
| Task | ODP-252 | Fix rendering of odp.version in hbase odp binary |
| Task | ODP-251 | Port HIVE-19138 for fixing Query Cache Result |
| Improvement | ODP-247 | Make Ranger setup db compatible with Python2 and Python3 |
| Epic | ODP-246 | Python2 to Python3 upgrade |
| Improvement | ODP-245 | Update Zeppelin to support ODP built Flink and Hadoop 3.3.6 |
| Improvement | ODP-244 | Update Spark 3 version to 3.5.1 |
| Improvement | ODP-240 | memleak Backport HIVE-24590-branch-3.1 |
| Improvement | ODP-239 | memleak Backport HIVE-26530-branch-3.1 - HS2 OOM-OperationManager.queryIdOperation cleanup |
| Improvement | ODP-238 | memleak Backport HIVE-26404-branch-3.1 |
| Improvement | ODP-237 | memleak Backport HIVE-24552-branch-3.1 |
| Task | ODP-236 | memleak Backport HIVE-24236-branch-3.1 |
| Task | ODP-235 | memleak Backport HIVE-16455-HIVE-24858-branch-3.1 |
| Task | ODP-234 | Update Jersey version to be compatible with Hadoop 3.3.6 (part of HIVE-27535) |
| Bug | ODP-226 | RANGER-3809: Implement authorizeByResourceType method of Kafka Authorizer |
| Bug | ODP-225 | RANGER-3231: Ranger should use Kafka Authorizer from KIP-504 |