All Posts (448)

Sort by

May 2022 President's Letter

Hello again to our IDUG members all over the world! I wanted to encourage every one of you to consider registering right now for the 2022 IDUG NA Db2 Tech Conference in Boston, USA, on July 11-14! A full Daily Schedule Grid is now available on our website, joining the full list of our technical breakout sessions’ presentations & presenters. And more agenda information is coming soon!   

As you know, our NA conference will be IDUG’s first hybrid event where you can participate on-site (to experience the full conference) or online (for access to select sessions). Today I wanted to note a few exciting pricing options for our members who will be joining us in Boston:

-FIRST-TIMERS DISCOUNT: Whether you are new to the IDUG community or not, if you have never been in-person at an IDUG North America conference before, you qualify for a 60% registration discount! Find out more here!

-HYBRID 3+5 PACK DISCOUNT: If you register three individuals from your organization to attend on-site, you get five FREE virtual registrations (~30% total registration discount). More details here.

-HYBRID 10+1 PACK DISCOUNT: If you register 10 individuals from your organization to participate online, you get one FREE on-site registration (also a ~30% total registration discount). More details here.

So, I have two quick items for you to consider to bolster your career development and to enhance your effective utilization of Db2 in 2022 and beyond:   

1-Review the Daily Schedule Grid of the 2022 IDUG NA Db2 Tech Conference in Boston and register here to attend the 2022 IDUG NA Db2 Tech Conference in Boston, USA, on July 11-14.

2-Registration is not yet open for the 2022 IDUG EMEA Db2 Tech Conference in Edinburgh, Scotland, on October 22-26. But you can still send in an abstract here by May 13, 2022, to be a presenter there!

IDUG is honored to strengthen everyone in this community by providing the highest quality education and services for Db2. We appreciate your support! Until next time—wherever you may be reading this—stay healthy and stay safe.

-Iqbal

Read more…

Read Now: IDUG President's Letter - April 2022

Hello again to our IDUG members all over the world! At the moment (although I’m almost hesitant to even say it), it finally does feel like our world may be expanding a bit, after contracting so much as it has over what has now been more than two years of this global pandemic.

Here’s an exciting snapshot of IDUG so far in 2022:

  • Two weekends ago, the IDUG Board of Directors held what was only its second face-to-face board meeting in the last two years
  • Last weekend, the EMEA Conference Planning Committee held its second face-to-face meeting since 2019
  • This weekend, the NA Conference Planning Committee will hold its first face-to-face meeting since 2019

Our very strong volunteer leadership program held IDUG together during this pandemic. So it is so wonderful to now be starting to get together in person to strengthen our personal bonds while we rejuvenate our professional organization.

Our NA conference will be IDUG’s first hybrid event where you can participate on-site (to experience the full conference) or online (for access to select sessions). We are now promoting several new group membership packages and we will soon be announcing our grid of technical sessions and expert speakers.     

I have three opportunities for you to consider to bolster your career development and to enhance your effective utilization of Db2 in 2022 and beyond:   

  1. Register here to attend the 2022 IDUG NA Db2 Tech Conference in Boston, USA, on July 11-14. 
  2. Send in an abstract here to present at the 2022 IDUG EMEA Db2 Tech Conference in Edinburgh, Scotland, on October 22-26.
  3. Follow IDUG in your favorite social media channels (FacebookLinkedInTwitter) to receive the latest and greatest about IDUG and Db2, including these NA and EMEA conferences and about other 2022 IDUG events across the globe.

IDUG is honored to support and strengthen everyone in this community by providing the highest quality education and services for Db2. Until next time—wherever you may be reading this—stay healthy and stay safe.

-Iqbal

Read more…

IBM Db2 13 for z/OS – AI Enriched

 

Enriched AI helps to improve operational efficiency and reduce costs.

REGISTER NOW FOR THE LAUNCH WEBCAST

10264629054?profile=RESIZE_710x

As organizations embark on their AI journeys, they face increasingly complex data management challenges – rapid data growth, rising operational costs, spreading siloes of duplicated data, demands for the most current data, faster and more accurate decision making, infusion of AI into their applications and transactions, growing regulatory requirements – all while reducing their security exposures wherever and however their data is stored.

As part of a data and AI solution, organizations are recognizing the value of a data fabric as a data management architecture that can help optimize access to data and intelligently curate and orchestrate it for self-service delivery to data consumers.  A data fabric can help provide faster, trusted AI outcomes by connecting the right data, at the right time, to the right people, from anywhere it’s needed.

Db2 for z/OS has a rich heritage of delivering the necessary qualities of service to address these pains points through its capabilities to:

  • Host and manage the world’s most business critical and up-to-date data.
  • Deliver the highest qualities of service to support modern mission critical AI and hybrid cloud applications.
  • Drive technical and cost efficiencies designed to address the unprecedented demand for secure, reliable, direct access to systems of record data.
  • Revolutionize Db2 management through new simplified experiences, powered by AI.
  • Simplify accessibility to mission critical data without moving or copying data.

 

Announcing IBM Db2 13 and Db2 AI for z/OS (Version 1.5)

Today, IBM announced the general availability of Db2 13 and Db2 AI for z/OS. Db2 13 for z/OS (Db2 13) delivers leading-edge AI innovations and enhancements, reinforcing it as the foundation for enterprise computing within the hybrid cloud and digital world - and a key component within an enterprise’s data fabric.

IBM Db2 delivers significant innovations and capabilities:

  • An innovative integrated approach to developing and deploying AI insights within applications
  • Infusing AI to help improve operational efficiency and reduce costs
  • Enhanced resiliency, efficiency, and application stability for unparalleled availability
  • Synergy with IBM z16 for enhanced efficiency and differentiating business value
  • Simplified database management and upgrades to help accelerate feature adoption and time to value

Db2 AI for z/OS helps organizations infuse AI throughout operations, transactions and applications for improved efficiency and better business outcomes. Here are a few examples:

  • Uses ML and AI to help improve operational performance and maintain the health of Db2 systems
  • Revolutionizes Db2 management through new simplified experiences, providing self-tuning / self-managing capabilities to Db2 for z/OS powered by AI
  • Provides better operational control over Db2 AI for z/OS processing
  • Addresses enterprise security and audit requirements with multifactor authentication
  • Applies intelligent insights using AI to predict and troubleshoot database performance

 SQL AI-Driven Data Insights

Competitive advantage hidden in data relationships can be difficult to identify which can result in missed opportunities for monetization. Traditional machine learning approaches can be effective, but require the right skills to draw out this valuable information and as such these relationships and insights could be completely overlooked unless done properly. Machine learning and data science approaches are often perceived as highly tailored processes requiring customized extract, transform, and model building processes along with additional infrastructure and software, requiring highly specialized data science skills.

IBM software is designed to help automate many of these complex challenges by applying machine learning throughout an organization’s AI journey involving the collection, organization, analysis of data and infusing AI into business processes and applications.

The Db2 for z/OS SQL Data Insights feature simplifies the data science process, helps reduce the time necessary to take advantage of AI, and identifies valuable hidden insight within enterprise data. It offers an innovative integrated approach to developing large-scale AI insights within a relational database for better business decisions. SQL Data Insights extracts exceptional business insight from Db2 for z/OS data through embedded, self-service AI functionality.

Db2 for z/OS provides automated neural network-powered semantic reasoning to identify similarities and correlations between Db2 for z/OS data points and relationships and extrapolate from one concept to another. With SQL Data Insights, customers can incorporate AI functionality within Db2 for z/OS applications and business intelligence (BI) tools to reduce infrastructure complexity, simplify application development, and deliver faster AI time to value.

Some of the key capabilities of SQL Data Insights are:

  • Uncovers data relationships and implicit insights hidden within customers' Db2 for z/OS data through SQL Data Insights AI-enhanced SQL
  • Enables any application, such as customer service and mobile applications, that can access Db2 for z/OS data to use SQL to benefit from AI insights
  • Uses Natural Language Processing to build Artificial Neural Network models on existing Db2 data without requiring data scientist skills
  • Delivers model-based explain capability
  • Exploits IBM z16 optimization to speed up training and query

Readily integrating AI within applications helps identify and monetize hidden insights within the data using SQL Data Insights that would otherwise be overlooked.

Learn More - Check out the Db2 SQL Data Insight Product Demo

AI infused in Db2 for z/OS for improved performance

Db2 for z/OS infused AI helps reduce staff costs and enhances application performance. It learns the patterns from the collected data from workloads in customers' unique operating environments and determines the optimal paths for SQL statements entering Db2 for z/OS. Infused AI technology reduces the need for data scientist support.

These AI capabilities help to better serve business and technical insights with improved support for application growth and performance with smarter insert processing, reducing the need for DBA performance-tuning expertise. Additionally, Db2 13 is designed to deliver the following features in these key areas:

  • Reduced CPU and index maintenance costs that help enterprises grow workloads.
  • Improved insert performance for PBG tablespaces.
  • With Db2 13, APREUSE offers the option to manage a more granular level access path reuse and reduce error or warning cases from rewritten queries.
  • Help reduce downtime for implementing application changes.
  • Enhanced sort optimization, which helps improve the performance of certain operations without changing how Db2 for z/OS is used.
  • Fast index traversal (FTB) support for larger index keys.
  • Reduced overhead for replication of subsets and data partitions.

Infusing AI helps to improve operational efficiency, reduce costs, and increase database administrator (DBA) productivity. Customers can experience improved application performance and business resiliency by exploiting AI and Machine Learning (ML) technology because it helps support application growth and performance with smarter insert processing. It can also help reduce CPU utilization through improved index maintenance, smarter sort optimization, and improved concurrency while minimizing any downtime when implementing application changes.

 

Enhanced Scalability, Security, and Compliance

Businesses need to be able to rapidly and dynamically adapt and react to changes in the marketplace. They should be able to expand their systems quickly and easily to meet the needs of the business, both for the long term or short term – including temporary seasonal changes or peak periods, without impacting availability. Db2 13 supports new and growing workloads without having to enact deep changes to the Db2 for z/OS environment.  It offers improved storage conditions, higher concurrent threads, and increased concurrent data sets for other Db2 activities. The Db2 installation and process for customizing the amount of private storage has been enhanced. There is also enhanced Disks Data Format (DDF) storage relief, which provides the means for customers to grow while helping to reduce outages. Organizations can also benefit from  the enhanced scalability and improved serviceability.

With each new release, Db2 for z/OS gets faster and more securable. In database environments security is critical. Continual monitoring for compliance with standards improves security.  To this end, Db2 for z/OS adds automated compliance evidence data collection that enables the IBM Security and Compliance Center solution to provide Db2 for z/OS customers with the compliance posture of application and infrastructure running in a Db2 for z/OS environment. This simplifies the regulatory controls validation for audits. And DBAs can create routine packages within the trusted context of Db2 for z/OS, which can result in significant productivity gains.

 

Db2 13 and IBM z16 – Better Together

Sometimes, things are just meant to be.  Downtime is the enemy of a business. It costs both time and money and can have grave consequences for organizations that are not sufficiently prepared, sometimes resulting in irreparable brand damage, public confidence, and trust. Analyst reports demonstrate that downtime costs $5,600 per minute on average. This results in average costs between $140,000 and $540,000 per hour, depending on the organization. Db2 13 increases resiliency with the exploitation of system recovery boost, which helps improve restart performance and minimize downtime. Db2 can exploit the IBM z16 hardware as follows:

  • New System Recovery Boost (SRB) in IBM z16 can help improve Db2 for z/OS restart performance, thereby minimizing downtime
  • Better insights to tune Db2 performance in data sharing environments with the exploitation of IBM z16
  • Expanded SORTL instruction usage based on machine learning on the amount of storage and the number of records being sorted, requires IBM z15 or higher
  • Exploits IBM z16 optimization to speed up training and query

 All this adds up to enhanced efficiency and differentiating business value for organizations.

Database Management and Upgrades - Simpler and Easier than ever Before

With all the benefits and capabilities, Db2 13 can help improve an organization’s time to value, enabling organizations to exploit new features and functions designed to avoid impacting availability, security, or performance. Organizations can enjoy the simplified process to upgrade to Db2 13 in a single phase. There is improved ability for Independent Software Vendor (ISV) products to better support data replication environments through the ability to write decompression dictionaries to the Db2 log – along with improved performance through enhanced REORG INDEX and the collection of real-time and historical information regarding utility executions.

 

Your Next Steps

This blog highlights just some of the key capabilities, benefits, and features of what IBM Db2 13 for z/OS has to offer organizations as part of their Journey to AI. It should hopefully remove any doubts as to why to upgrade from earlier versions.

If you need help with any aspect of your Db2 installation, implementation or upgrading, IBM provides help in the form of its many services offerings such as IBM Systems Lab Services, IBM Consulting, IBM Technology Support Services, IBM Expert Labs, IBM Security Expert Labs.

 

If you’re interested in learning more about Db2 13 for z/OS and its many benefits, please visit:

 

Steven Astorino,

VP of Development, Data and AI, and Canada Lab Director

Read more…
In this blog we will discuss about the Capture Query environment and performance data functionality that is supported by IBM Db2 Analytics Accelerator for z/OS (IDAA) to gather query environment information to help understand and address query performance issues. With query acceleration being the primary business value proposition for IDAA it is always important to understand the environment in which the query is executing to help achieve optimal query performance .  The need for a robust means to gather information about the environment in which queries execute is amplified in the case where complex, resource intensive, analytical queries are being executed on the IDAA. 
 
Since versions 7.5.1 and 7.5.3 of the IDAA server, this new capability to allow Capturing query environment and performance data has been supported. As you may be aware, IDAA uses a Db2 Warehouse columnar engine as the datastore. When eligible for acceleration, Db2 for z/OS sends the queries over to IDAA for execution. In case of performance issues, collection of query environment and performance data can be enabled. When enabled, the queries need to be re-executed under the covers to gather the necessary information.  
 
Initiating the data capture can be done by invoking the ACCEL_CONTROL_ACCELERATOR with the following inputs or using the existing Data Studio interface to administering IDAA. 
 
202d8500-799a-11ea-9335-4a9eeca002cf
 
Since the query is executed under the covers and may be long-running, the timeout value here allow users to control how much longer the query will be allowed to execute to capture environment data.  This execution of the query along with performance tracing enabled will utilize Db2 Warehouse resources and may potentially impact performance of other IDAA operations, depending on the nature of the query.

52d77d80-799a-11ea-933b-06b5be6c0564
 
 
Once the capture has been initiated, saving the trace with the option to also gather the Manually collected trace information will combine the query and performance trace data as part of the downloaded traces to allow users to analyze and share with the support teams for further analysis. 
 
This doc along with the default IDAA trace can help provide actionable steps to resolve the query performance problem. Some examples include, but are not limited to the following:
 
This can also be automated in a batch process using the sample stored procedure ACCEL.GET_QUERY_HISTORY2 How to store Db2 query history in a Db2 for zOS table . With GET_QUERY_HISTORY2 running at a set interval, i.e. every 5 minutes, a batch application can set a threshold for total elapsed time. For queries that exceed this threshold call ACCEL_CONTROL_ACCELERATOR automatically to collect the query environment data and performance docs. 
 
<?xml version="1.0" encoding="UTF-8" ?>
<aqt:controlCommand xmlns:aqt="http://www.ibm.com/xmlns/prod/dwa/2011"
 version="1.0">
    <getAdditionalSupport planID="0" traceCommand="CDE_PERFORMANCE_TRACE"
     timeoutInMinutes="0"/>
</aqt:controlCommand >


Then at another interval (every 24 hours), call ACCEL_CONTROL_ACCELERATOR to save the trace . 
 
<?xml version="1.0" encoding="UTF-8" ?>
<aqt:controlCommand xmlns:aqt="http://www.ibm.com/xmlns/prod/dwa/2011" 
 version="1.0">
    <getTraceData keepConfiguration="true">
        <content>ACCELERATOR</content>
        <content>ADDITIONALSUPPORTINFO </content>
    </getTraceData>
</aqt:controlCommand>
 
NoteDocuments saved from capture query environment and performance data are automatically deleted on the accelerator after 7 days.
Read more…

IDUG North America 2022 | Boston, MA | July 11-14  REGISTER NOW

 

  10214507269?profile=RESIZE_710x

 

Registration is Open Now!

IDUG's 2022 North America Db2 Tech Conference will be held at the Sheraton Boston on July 11-14, 2022 [some optional pre-conference events could occur on July 10, 2022]. 

This year’s North America event is a hybrid conference: you can register to attend on-site or to participate online. Register now for the conference, then (if you will be participating on-site) reserve your lodging at the Sheraton Boston!

Conference Sponsorships Available... 

Connect with your customers at IDUG 2022 NA! Click here for the sponsor prospectus that explains exhibit and marketing opportunities to share your expertise with our audience. IDUG will be bringing together the global Db2 community for four days of in-person exploration and collaboration in July. Reach out to us at cyndi@teamycc.com to learn about all our opportunities.

Schedule & Speakers Announcements Coming Soon...

IDUG’s North America Conference Planning Committee (CPC) is finalizing the schedule and speakers for IDUG 2022 NA. If you have any questions about the schedule and speakers, please reach out to CPC member Chris Muncan at chris.muncan@gmail.com

 

Read more…

Read Now: IDUG President's Letter March 2022

Hello again to our IDUG members all over the world. I know that everyone in the Db2 User community is really excited about 2022. In addition to our plans to return to face-to-face IDUG events this year, this will be a very big year for Db2!

Of course, we hope to see you in person at our Db2 Tech Conferences in Boston and Edinburgh. But if you participated virtually in the 2021 IDUG EMEA conference last December, you already know what will make 2022 so special. IBM will be announcing a new release of Db2 for z/OS this year!

It has been five years since the announcement of Db2 12. And with the announcement of continuous delivery and regular new Db2 functions and features on demand, many of us wondered if there was going to be any "major” releases from IBM ever again. But the world changed with Data Fabric and AI, when the wants and needs of Db2 users everywhere grew so rapidly.  

IBM Db2 Vnext for z/OS will deliver significant innovations and capabilities around:

  • Innovative integrated AI approaches to developing and deploying AI insights within applications
  • Infusing AI to improve operational efficiency and reduce costs
  • Enhanced resiliency, efficiency, and application stability for unparalleled availability
  • Synergy with IBM z16 for enhanced efficiency and differentiating business value
  • Simplified database management and upgrades to help accelerate feature adoption and time to value

I have three opportunities for you to consider to bolster your career development and to enhance your effective utilization of Db2 in 2022 and beyond:   

1-Send in an abstract here to present at the 2022 IDUG EMEA Db2 Tech Conference in Edinburgh, Scotland.

2-Follow IDUG in your favorite social media channels (FacebookLinkedInTwitter) to receive registration information soon for the 2022 IDUG NA Db2 Tech Conference in Boston, USA (and other upcoming IDUG events across the globe).

3-Register here to join the IBM announcement webinar called “Db2 Vnext AI Infused with Data Insights – A Critical Component of Your Data Fabric Strategy” on April 6, 2022, from 11:00 AM – 12:30 PM Eastern Time.   

IDUG is honored to support and strengthen everyone in this community by providing the highest quality education and services for Db2. Until next time—wherever you may be reading this—stay healthy and stay safe.     

10209466865?profile=RESIZE_710xIqbal

Read more…

By James Gill

Introduction

A long time ago (in a galaxy far, far away), I began this series with the intention of blogging about using Jenkins to orchestrate some tasks on z/OS. I did an introduction to Jenkins and one on groovy pipelines

 

In this blog post, we’re going to look at what we need to do to run a Jenkins node on z/OS. It should be noted that this runs as a process in USS, and we’re going to assume that you’re comfortable there. In many ways, this is a regular Posix Unix environment, albeit with extensions to reflect the fact that we’re running as part of z/OS.

Read the blog in full.

10180914679?profile=RESIZE_710x

 

Read more…

Tablespaces: where exactly is my data?

By Mark Gillis

This should be pretty straight-forward: you can look in the TABLES System Catalogue and find references for the data (TBSPACE), Indexes (INDEX_TBSPACE) and Large Objects (LONG_TBSPACE). But DB2 throws a few curved balls here; partitioned tables (where the data, indexes and LOBs can be in multiple tablespaces), particular types of index that don’t seem to be in the catalogues at first glance, etc. Let’s see if we can put something together that shows the complete picture.

 

Overview

I’ve got a little database with all sorts of weird and wacky objects. It’s tiny, in terms of volume, but includes row and column-organized tables, range-partitioned tables, MQTs and a bunch of other stuff. Some tables have the full “INDEX IN … LONG IN ….” Tablespace definitions but don’t actually use them, some don’t have any or all the tablespace directives. I want to be able to see the full picture, so how do I go about that?

Click here to find out. 

 10164642078?profile=RESIZE_710x

 

Read more…

Db2 for z/OS Development is offering a week-long Db2 for z/OS Master Class, led by Distinguished Engineer, John Campbell, for experienced Db2 for z/OS System Engineers and Database Administrators. During this class, he will discuss the most common issues related to continuous availability and speed of recovery in Db2 for z/OS environments, and will share proven best practices to exploit the full power of Db2 for z/OS and IBM Z mainframes. He will also provide a deep dive on how to monitor and tune Db2 for z/OS system and transaction performance using Db2 Statistics and Accounting traces.

This is a CLIENT-ONLY course and client participation is BY INVITATION only.

There will only be two offerings of the Db2 for z/OS Advanced Class in 2022 and seating is very limited. 

  • Monday, June 20, 2022, (9:00 am) to Friday, June 24, 2022, (2:30 pm) British Standard Time (BST) 
  • Monday, September 19, 2022, (9:00 am) to Friday, September 23, 2022 (2:30 pm) Pacific Time (PT)

 

For more details and to register, see https://ibm.biz/db2zos-master-class-2022

Read more…

By Vassil Dimov, Mateo Tošić and Sowmya Kameswaran

Introduction

In the previous blog post we have introduced Db2 for z/OS Data Gate and described it in detail. In this blog we will discuss the integration between Db2 Data Gate and Watson Knowledge Catalog and highlight the business value of it.

AI Ladder

In the current business world, modernization of data and use of AI is the key to success. The guiding principles of the AI ladder defined by IBM, help organizations with business transformation based on the four key areas mentioned below:

  1. Collect — Make data simple and accessible (All data sources contribute to this pillar)
  2. Organize — Create a business-ready analytics foundation (Data governance services like Watson Knowledge Catalog)
  3. Analyze — Build and scale AI with trust and transparency (Watson Studio)
  4. Infuse — Operationalize AI throughout the business (this is what customers do with the data in their own products)

In this blog we will discuss how Db2 Data Gate and Watson Knowledge Catalog, representing the first two pillars of the AI Ladder, can help organizations to unlock the huge value of their Z data in the cloud.

About Db2 Data Gate

Db2 Data Gate enables modern high-volume, high-frequency hybrid cloud applications that need read-only access to valuable enterprise data from Db2 for z/OS. It plays a key role in the Collect pillar by enabling movement of data from Db2 for z/OS into the Cloud Pak for Data platform. With data synchronization between source Db2 for z/OS and target IBM Db2 and IBM Db2 Warehouse, applications are able to get access to current data. To learn more about IBM Db2 for z/OS Data gate, please read “What is Db2 Data Gate? Db2 Data Gate Blog Series Part 1

About Watson Knowledge Catalog

Watson Knowledge Catalog (WKC) is an enterprise data catalog management platform that forms the core of the Organize pillar of the Cloud Pak for Data platform. A catalog connects people to the data and knowledge that they need. It is the key enabler to building the enterprise data catalog on Cloud Pak for Data that enables platform users to find, prepare, understand, and use the data as needed. The data governance framework ensures that data access and data quality are compliant with your business rules and standards.

WKC unites all information assets into a single metadata-rich catalog, based on Watson’s understanding of relationships between assets and how they’re being used and socialized among users in existing projects. It is integrated with an enterprise data governance platform that merges the analytics capabilities of Watson Studio. The data catalog assists data scientists in easily finding, preparing, understanding and using the data as needed.

Data protection has gained importance in recent years. That is why it is so important that WKC protects data from misuse and enables sharing of assets with automated, dynamic masking of sensitive data elements. This avoids violating various data protection regulations. For instance, when handling healthcare data in the USA, companies need to be aware of HIPAA (Health Insurance Portability and Accountability Act), a set of rules on how personally identifiable information maintained by the healthcare and healthcare insurance industries should be protected from fraud and theft. Moreover, any company based in the EU or offering services to people in the EU must comply with GDPR (General Data Protection Regulation), which has a much broader scope and governs the use of all personal data.

Db2 Data Gate — Watson Knowledge Catalog integration highlights

Watson Knowledge Catalog provides fine-grained control of data from various sources to users who need access to them. While administrators have the most permissions, data scientists and developers can only access data that is published to catalogs. Business analysts can, in addition to that, view data quality and access information asset views, while data engineers and data stewards can discover assets, import metadata, and access governance artifacts. The benefits are numerous for different user personas.

With the combination of Data Gate and WKC, data scientists and software engineers can explore the most important enterprise data coming from the mainframe and use all tools they are familiar with in the cloud for analysis and modeling and prototyping. They can benefit from tools, like schema structure discovery, to further accelerate the development of models and application. They do not even need to look for connection metadata since all assets are cataloged and accessible in just a few clicks.

Data stewards, on the other hand, can easily work on data quality using governance artifacts, such as business terms, business glossary, classifications, and automatic data profiling in WKC. They can define which columns from Db2 for z/OS are visible for whom in the cloud. More importantly, they can take care of regulations mentioned above (GDPR, HIPAAA, etc.). This has significant importance for data coming from Db2 for z/OS, as a data store containing the most sensitive customers’ data. On top of that, they can use rules, such as automatic data deletion, triggered once data on Z is deleted (e.g., customer related analysis for some customer that needs to be deleted once they leave the company).

In addition to the above, one of the other key benefits is the ability to understand and track data lineage — the journey made by the data from source through any transformations all the way till usage. Data lineage is very important when it comes to making sure the data is coming from the right source, being handled by the right people, undergoing the right transformations and landing in the right target. When Db2 for z/OS data is brought into the platform by Db2 Data Gate and then discovered and imported into the catalog, the data lineage can easily be maintained allowing data custodians to keep track of data all the way from the source. Last but not least, the usage of Db2 Data Gate allows to discover schema changes which can be maintained in the data linage of the data asses in WKC.

Steps to connect DG with WKC

Create a new catalog

Give your catalog a name and, optionally, a description. This catalog will be used to add the connections and assets to it.

1*-TYXylG1oublSAn4RHDOqQ.gif

Create the source connection

Choose Db2 for z/OS and type in the credentials and other parameters (host, port, etc.). WKC will use this metadata to access your database when you add some assets. You can click on “Test Connection” before creating it.

1*wZrF-BSIrVLm8qTmRFkvsQ.gif

Add a source data asset

Choose the schema and the table you want from the newly created source connection. In the Assets tab you can see a preview of the data.

1*XjTJMd1VjZZQ3rg8DEwoqw.gif

Create the target connection and add a target asset

Repeat the process from two previous steps. Instead of Db2 for z/OS choose Db2 or Db2 Warehouse according to your target database.

1*IHm-RfspA7LX8gQ7GRP7Sw.gif

Add relationships to the data assets and connections

IsSameAs can be used to mark the source connection to be same as the target connection, but also to mark the source data asset to be same as the replicated, target data asset. IsContainedIn can be used to mark a data asset as contained in a connection (or Contains in the opposite direction).

1*XyWfyIZjKro04D-XGnhr9Q.gif

Create Data Profile

(Benefit 1 — for Data Steward)

Data Profiles include generated metadata and statistics about the content of a data asset. An asset profile helps data stewards understand what actions to take to improve the data quality.

1*3McA-3HLClQJ4AEAFWPFRg.gif

Use the data assets in Watson Studio

Create a project and add data assets

(Benefit 2 — Data Scientist / Software Engineer)

If you go to Watson Studio and create a new project (or use an existing one), you can add data assets from this catalog to it.

1*Agu_qKMniI2OkGgXaLQhfA.gif

Create a notebook and load an asset into a data frame

Then you can use that asset for data analysis and modeling. In a Python/R notebook you will get an automatically generated block of code. Watson Studio will ask WKC for data and WKC will use the connection metadata to retrieve the data from the database. You can use the loaded data as a data frame.

1*3VuYnQofeF3R9XBlSc5Yvw.gif

Conclusion

We have shortly described Db2 Data Gate and introduced Watson Knowledge Catalog. We pointed out the benefits of their integration. By following the step by step video you were instructed how to get the integration yourself. To better materialize the benefits we went through a couple of example scenarios likely to be relatable in your usage flow.

For further reading, please check Daniel's blog here on Use Current Db2 for z/OS Data on Cloud, Without Direct Mainframe Access and Without Loosing Control Over Your Data

Read more…

In part one of this blog James Cockayne looked at what might happen to a DB2 database that was attacked by ransomware encryption.  

In part two James shares four dos and four don’ts to help protect DB2 databases from ransomware attacks.

https://www.triton.co.uk/ransomware-and-the-db2-database-part-two/

9860513277?profile=RESIZE_710x

Read more…

Read Now! IDUG President's Letter: November 2021

9788203482?profile=RESIZE_400xWith an uptake of more and more people being vaccinated against Covid-19, countries have opened their borders for travel over the past few months. This has opened the doors for IDUG committees to conduct their meetings face to face after almost two years. Face to face interaction is important for all of us at our workplace and more so for IDUG volunteers who give up some of their out of work time to help IDUG conduct it’s many activities. It helps rejuvenate what we believe in and keeps us motivated. A big thank you to all our volunteers for adapting to an online world over the past couple of years and continuing to help and support IDUG. 

This month, the first ever IBM Community Festival 2021 is happening over November 8-10 and November 16-17. It’s online gathering for IBM user groups, clients, technology experts, distinguished engineers, & everyone else—to exchange technical knowledge & information about IBM products & services. See here for more details. I will be presenting on Monday, November 8. Please join me to learn all about IDUG – your organization! Check out the full agenda here

On a high note, our IDUG Virtual 2021 Db2 Tech Conference is just round the corner over December 6-10. The Conference Planning Committee has been working hard to assemble a great agenda of sessions for you. Please register for a conference not to be missed!

 And to end on another high note, I am excited to announce that the IDUG 2022 NA will be held in Boston on July 9-14, 2022. This will be our first face to face event in 2 years! Call for speakers is now open. Please consider submitting an abstract. 

As always, please reach out to me with any questions, suggestions, or concerns. I am just an email away at iqbal@idug.org

Iqbal Goralwalla, IDUG President

https://www.idug.org/blogs/iqbal-goralwalla/2021/11/02/november-news-upcoming-events-conference

Visit IDUG's website for more information

 

Read more…

This is the fourth in a four-part series of articles addressing Db2 for z/OS and modern development utilizing an Agile methodology and DevOps processes. To read the first three articles please follow these links:

https://community.ibm.com/community/user/hybriddatamanagement/blogs/daniel-luksetich/2021/06/21/traditional-db2-development-vs-modern-development

https://community.ibm.com/community/user/hybriddatamanagement/blogs/daniel-luksetich/2021/08/09/devops-and-modern-it-defined

https://community.ibm.com/community/user/hybriddatamanagement/blogs/daniel-luksetich/2021/09/14/the-ibm-unified-management-server-and-db2-for-zos

In this article we address the critical needs of the Db2 for z/OS professional and the way these needs are met with the IBM Db2 DevOps Experience for z/OS. In addition, it will look at the needs of the modern Application Developer and the enterprise advantage to keeping your systems of engagement and innovation close to your system of record.

To read the entire article follow this link:

https://community.ibm.com/community/user/hybriddatamanagement/blogs/daniel-luksetich/2021/11/03/ibm-db2-devops-experience-for-zos

Read more…

This is the third article of a four-part series addressing Db2 for z/OS and modern development utilizing an Agile methodology and DevOps processes. To read the first two articles please follow these links:

https://community.ibm.com/community/user/hybriddatamanagement/blogs/daniel-luksetich/2021/06/21/traditional-db2-development-vs-modern-development

https://community.ibm.com/community/user/hybriddatamanagement/blogs/daniel-luksetich/2021/08/09/devops-and-modern-it-defined

There has undoubtedly been substantial confusion concerning the various IBM software products that provide mainframe connectivity for web applications, what they do, what they cost, and what needs are they trying to serve. These include, but are not limited to; z/OSMF, z/OS Connect, Zowe (not IBM software, but open-source software that runs on z/OS), CICS Transaction Gateway, and now The IBM Unified Management Server for z/OS. Are all these servers related? No, they are not! Can some of the functionality of these servers overlap? Perhaps, but that is not the focus here. The question to be answered is what is the IBM Unified Management Server (UMS) and what benefits can be derived from installing it on a z/OS system?

To read the entire article follow this link:

https://community.ibm.com/community/user/hybriddatamanagement/blogs/daniel-luksetich/2021/09/14/the-ibm-unified-management-server-and-db2-for-zos

 

Read more…
The OMEGAMON Db2 Enhanced 3270 User Interface main workspace displays statistical values which are totals since the start of Db2. Because a DB2 subsystem runs for a long time the statistics may not be relevant to more recent problems. Situations and highlighting of fields can become almost meaningless because the values are too large. With this enhancement (APAR PH35707 PTF UI76291) you will be able to display Db2 Statistics for a recent interval for example the last 24 hours. Now situations and thresholds can be based on recent values like deadlocks that occurred today.
Read more…

By Mark Gillis

There are easily accessible means of checking what your Stored Procedure needs in the way of dependent objects (SYSCAT.ROUTINEDEP, basically). So, what if you find a, or a number of, Stored Procs that are marked as needing a REBIND and then, when you do that rebind, you get an SQL0440 indicating that “something” is missing. How do you go about checking that situation out? Find out here

9756322693?profile=RESIZE_584x

Read more…

By James Cockayne

By now I’m sure everyone has heard of the malicious practice known as ransomware attacks, where miscreants break into a corporate network and encrypt data before demanding huge sums of money to provide a method to decrypt that data and make it accessible again.  The attacks tend to be insidious – sometimes the attacker is in the network for months before they gain access to the systems they are interested in, and they are known to target backup servers as well as the primary systems to cause maximum inconvenience to the target organisation. 

Find out what an attack on a DB2 Database would look like. Continue reading James Cockayne's latest blog. 

https://www.triton.co.uk/ransomware-and-the-db2-database-part-1/

 

 

Read more…