Software & IT Archives - IBA Group - USA https://us.ibagroupit.com/tag/software-amp-it/ Thu, 21 Nov 2024 13:45:16 +0000 en-EN hourly 1 https://wordpress.org/?v=6.5.5 TechChannel Names IBA Group Engineers IBM Z Rising Stars 2024 https://us.ibagroupit.com/news/techchannel-names-iba-group-engineers-ibm-z-rising-stars-2024/ Thu, 21 Nov 2024 13:45:16 +0000 https://us.ibagroupit.com/?post_type=news&p=13382 The post TechChannel Names IBA Group Engineers IBM Z Rising Stars 2024 appeared first on IBA Group - USA.

]]>

TechChannel announced the honorees of its 2024 IBM Z Rising Stars recognition that highlights emerging talent in the IT ecosystem. This year’s list includes Uladzislau Kalesnikau and Aliaksandr Shautsou of IBA Group. The young mainframe experts are acknowledged for their innovative work in advancing IBM Z technologies.

Mainframe Modernization at IBA Group

Uladzislau Kalesnikau, a team lead at IBA Group, is committed to modernizing mainframe technology. As the lead developer of Zowe plugins for IntelliJ IDEA, Kalesnikau makes it easier for young developers and newcomers to engage with the mainframe environment. With four years in mainframe development, he made an outstanding contribution to integrating modern tools into the mainframe environment. Kalesnikau also plays an active role in the global mainframe community, promoting Zowe plugins and DevOps practices.

Aliaksandr Shautsou is a middle software engineer at IBA Group’s mainframe development team. He has contributed to Zowe initiatives that empower developers to work in modern integrated development environments like IntelliJ IDEA and VS Code.

Irina Kiptikova IBA Group Corporate Communications Director

Our Rising Stars stand out for their exceptional work in mainframe modernization. Their efforts ensure that the mainframe remains a relevant and accessible platform for the next generation of engineers.

About TechChannel IBM Z Rising Stars

The TechChannel IBM Z Rising Stars program highlights talented IT professionals working on IBM Z or IBM Power platforms for five years or fewer. Since its inception, the program has recognized individuals making significant technical contributions and fostering positive change in their organizations and the IT ecosystem. With 23 honorees, the 2024 class is the largest yet, showcasing a new wave of IT talent that advances technical innovation and promotes community growth.

The post TechChannel Names IBA Group Engineers IBM Z Rising Stars 2024 appeared first on IBA Group - USA.

]]>
Building profitability calculation for a multinational technology and consulting company https://us.ibagroupit.com/cases/building-profitability-calculation-for-a-multinational-technology-and-consulting-company/ Thu, 13 Jun 2024 13:03:20 +0000 https://us.ibagroupit.com/?post_type=cases&p=11693 The post Building profitability calculation for a multinational technology and consulting company appeared first on IBA Group - USA.

]]>

BACKGROUND

Our client is a multinational technology and consulting firm, renowned for its contributions to the development of computer hardware and software. They required help to identify which projects within the company were generating profits and which were not meeting financial expectations. This evaluation was necessary to optimize resource allocation and improve overall business efficiency.

CHALLENGES

  • Profitability calculation and P&L construction for BM Global Business Support projects, including analytics by region, industry, and client cluster.
  • Constructing of a calculated target model.

SOLUTION HIGHLIGHTS

  • Creating and optimizing applications in IBM Analytics Planning.
  • Writing scripts to calculate targets.
  • Integration with external systems and development of ETL procedures to obtain data from third-party sources.
  • Using a Java user interface for direct access to cubes (via REST API).
  • Presenting data both in cubes for data input and reporting cubes, organizing export/import of data.
  • Setting up access rights and monitoring the work of users.

KEY RESULTS

  1. Improving the relevance and reliability of profit and loss statement calculations for current and planned projects.
  2. Stable system operation under high loads thanks to an optimal calculation process and system configuration.
  3. Expansion of the system to cover LA (Latin America), EMEA (Europe, Middle East, Africa), and APAC (Asia Pacific) regions with consideration to regional specifics.

The post Building profitability calculation for a multinational technology and consulting company appeared first on IBA Group - USA.

]]>
HR Data Migration to the Cloud for an IT company https://us.ibagroupit.com/cases/hr-data-migration-cloud-it-company/ Wed, 17 Jan 2024 08:24:27 +0000 https://us.ibagroupit.com/?post_type=cases&p=11070 The post HR Data Migration to the Cloud for an IT company appeared first on IBA Group - USA.

]]>

Challenges

  1. Merging data from diverse HR platforms
  2. Navigating multiple disparate HR systems, which had created data redundancies and inconsistencies, making it hard to extract a single source of truth
  3. Development of data flow mappings
  4. Data quality management implementation
  5. Data masking for personally identifiable data based on access level
  6. ETL design and implementation data integration into the global DWH solution
  7. Making sure that the cloud-based HR solution was compatible with other business tools and systems used in different departments, which was crucial for holistic business operations

Goal

Build SaaS for offices all over the world to manage the administrative processes required to track and support employees

Results

  1. HR teams, managers, and employees have secure access to necessary data from anywhere and real-time analytics
  2. Migration for 39 countries implemented successfully, taking into account all regulations
  3. Developed, reinvented, and modernized the HR system for all HR-related tasks and procedures
  4. Advanced encryption and security protocols ensured sensitive HR data is protected
  5. Collaboration and self-service capabilities make employees more engaged in teamwork. Satisfaction has increased by 50%
  6. Various HR tools and applications were easily integrated, breaking data silos

The post HR Data Migration to the Cloud for an IT company appeared first on IBA Group - USA.

]]>
AI-driven Solution of Road Traffic Analysis for a Mobility Solutions Company https://us.ibagroupit.com/cases/ai-driven-solution-road-traffic-analysis/ Wed, 17 Jan 2024 07:57:06 +0000 https://us.ibagroupit.com/?post_type=cases&p=11073 The post AI-driven Solution of Road Traffic Analysis for a Mobility Solutions Company appeared first on IBA Group - USA.

]]>

Challenges

  1. Data analysis and visualization from different sources through all departments
  2. Hypothesis validation, implementation and the deployment of predictive models
  3. Setting up Big Data infrastructure in AWS Cloud
  4. Implementation of data quality management
  5. Row Level Security implementation for secure access
  6. Costly hardware and software licensing

Goal

Create a road traffic analysis solution to manage big volumes of data and cut financial losses

Results

  1. The company benefits from up-to-the-minute insights into traffic patterns and congestion, enabling it to provide more accurate and timely information to its customers
  2. The Client’s management now makes better-informed decisions, leading to optimized operations, and improved service quality
  3. The risks of financial losses are eliminated with the help of protection against unauthorized access
  4. Data leaks and compliance violations were eliminated

The post AI-driven Solution of Road Traffic Analysis for a Mobility Solutions Company appeared first on IBA Group - USA.

]]>
AWS cloud migration for a global company https://us.ibagroupit.com/cases/aws-cloud-migration/ Mon, 24 Oct 2022 16:01:25 +0000 https://us.ibagroupit.com/?post_type=cases&p=9111 The post AWS cloud migration for a global company appeared first on IBA Group - USA.

]]>

Background

А huge global company with a strong technology focus turned to IBA Group with the task of transferring their client’s infrastructure to cloud services. At the time of the beginning of cooperation, the end customer of our client used a lot of data storage for the following internal service tasks:

  • production cost tracking;
  • dialer’s information;
  • providing information to dealers,
  • information about clients, employees.

The main part of the infrastructure was based on the Oracle database and the Informatica Power Center ETL tool, as well as many other tools such as Cron, Shell Script, Java, JS.

Several years ago, the company’s management decided to migrate the entire infrastructure to the cloud. During modernization, the company brought production processes to a single standard, increasing its structure, including a unified approach to development, implementing an approved technology stack, and ensuring quality control of development.

Business Challenges

During the modernization process, the end client encountered the following difficulties:

  1. The existing services of the company were slow, which impacted all processes — from data analysis to hiring employees.
  2. Frequent failures due to errors within the services led to a partial loss of data and the inability to make management decisions, prepare accounting reports, prepare data on the movement of warehouse resources, and more.
  3. Permanent delays in providing new services due to the slowdown in development or the impossibility of their implementation, led to a decrease in the company’s attractiveness among customers.
  4. Scaling within the framework of the old infrastructure could not be carried out without extra payments, due to the low flexibility of vendor licensing offers.
  5. Recruitment of the necessary employees such as full-stack developers presented difficulties due to the huge variety of technologies used; cheaper resources were not of the right quality or up to the high standards of the company.
Key Objective #1

Migrate company services to new infrastructure in the cloud.

Key Objective #2

Tailor AWS vendor migration offerings to company services.

Solution Highlights

The customer formed a separate team that was responsible for the innovation and unification of disparate systems into a single infrastructure. IBA Group provided engineers and architects to form custom teams to participate in the adaptation of infrastructure modernization solutions, developing the top-level structure of the entire ecosystem, as well as general approaches and rules for each system separately.

After giving recommendations for the development and auditing of the process, the IBA Group team directly implemented this migration. To improve the quality of decisions made at the architecture design stage, an AWS vendor was involved.

Due to the business’s specific features, each area had its own architecture, for which separate teams were created that were responsible for its adaption and improvement. They were also involved in the transfer of existing services for their area to cloud technologies — AWS Glue, PySpark, ECS, Kubernetes, EMR + PySpark.

One of the important conditions was a “seamless” transition — teams during the migration process ensured that access to existing services remained uninterrupted.

Project Results

Benefits the client received by moving data management to a cloud service:

  1. Increased fault tolerance by fixing bugs and using ready-made cloud-platform services for interaction between different customer services.
  2. Continuity of current services during the migration process was maintained.
  3. Cost reduction in the form of refusal of some server capacities due to the transition to the cloud service.
  4. Flexible planning of financial expenses for scaling due to the pay-as-you-go system provided by the cloud solution.
  5. Reduced time for recruiting specialists in the IT department by unifying the requirements for them, defining clear rules, and specifying the technology stack.
  6. Reduction of the number of narrowly focused specialists without full-time employment due to their retraining in the technology stack adopted by the company.

The post AWS cloud migration for a global company appeared first on IBA Group - USA.

]]>
Development of a Cognitive Platform for Enterprise Data Management https://us.ibagroupit.com/cases/cognitive-enterprise-data-platform/ Mon, 10 Oct 2022 08:43:04 +0000 https://us.ibagroupit.com/?post_type=cases&p=9080 The post Development of a Cognitive Platform for Enterprise Data Management appeared first on IBA Group - USA.

]]>

Business Challenge

Build a secure and scalable data aggregation and analytics cognitive platform that transforms key business processes.

Solution

IBA Group developers worked on the Cognitive Enterprise Data Platform (CEDP). This platform makes it easy to get, share, and integrate enterprise data. Various business units of the company interact with the platform as producers and consumers of data.

Result

CEDP currently contains over 100 enterprise data assets. Datasets include customer master data, product offering master data, unified taxonomy, and more.

CEDP has big data analytics capabilities such as BigSQL, HDFS, DashDB for performance-based analytics, unstructured data annotation capabilities, machine learning, deep learning, and access to IBM Cloud Services.

The post Development of a Cognitive Platform for Enterprise Data Management appeared first on IBA Group - USA.

]]>
ETL Tool Visual Flow https://us.ibagroupit.com/solutions-and-products/visual-flow/ Fri, 13 Aug 2021 11:32:31 +0000 https://us.ibagroupit.com/?post_type=solutionsandproducts&p=7715 The post ETL Tool Visual Flow appeared first on IBA Group - USA.

]]>

Visual Flow

GET STARTED. Build ETL Pipelines Today

An ETL tool powered by Apache Spark on Kubernetes

We developed Visual Flow as a low-code solution for developers looking to leverage the ETL benefits of Spark without learning a programming language.

Try Visual Flow on AWS or GitHub

Apply for online demo

Visual Flow Logo

visual flow on AWS

visual flow on github

 

SPARKING ETL

A Low-Code Option for Building and Scheduling Spark Jobs.

We developed Visual Flow so you can jump-start Spark without writing a single line of code.

Until now, you’ve relied on a single-node ETL system. Now, your data is growing faster than your current engine can manage it. Distributed ETL engines like Spark offer tremendous upside. But when faced with coding jobs and pipelines manually, you run into a dilemma:

You don’t have time to learn coding languages
You can’t afford to hire external programmers
You don’t want to master an ETL tool, a build tool, and an orchestration tool
Your data continues to multiply out of control

The difficulty, expensiveness, and inefficiency of these options make Spark ETL seem impossible.

What You Will Get

By using Visual Flow, you will gain access to Spark ETL, transforming your data reserves into actionable wisdom.

Simplify ETL with a Drag-and-Drop Interface

Forget about Python, Scala, and Java, and embrace low- to no-code ETL on an easy-to-use interface.

Under-the-Hood Build and Orchestration

Visual Flow incorporates Argo Workflows, Kubernetes and the Spark processing engine. By mastering Visual Flow, you reap the benefits of all three software products.

Scale at the Speed of Data

Chain functions into jobs, then chain jobs into pipelines to transform raw data into Business Intelligence.

Visual Flow in Enterprise Infrastructure

How Visual Flow Works

Technical Features

Visual Flow is ETL, simplified. It allows users to leverage the scaling and efficiency capabilities of Spark ETL through an intuitive drag-and-drop interface.

Visual Flow includes:

  • Stage palette featuring nine discrete data transformation functions
  • Slack integration for user notifications
  • Support for data sources, including

● Relational DBs: IBM DB2, PostgreSQL, Oracle, MySQL, MSSQL, Amazon Redshift, ClickHouse

● NoSQL DBs: Elasticsearch, Cassandra, Redis, Mongo

● Cloud Object Storages: Amazon S3, IBM Cloud Object Storage

● Others: local files, dataframe

  • Ability to externally invoke Visual Flow pipelines using POST requests
  • GitHub and GitLab user directory support

Our Guiding Principles

Go Open Source

Visual Flow is an open source product that is based on other open source products.

Scale Optimally

Virtually unlimited horizontal scalability is provided by Spark.

Design Once — Run Anywhere

Once designed, deploy your ETL on any Kubernetes cluster anywhere.

Design Visually

Think of your data flows instead of the programming language syntax.

HOW TO USE VISUAL FLOW

Visual Flow is a low-cost, low-code, open-source product. Its portability, flexibility, and multi-cloud capability make it a powerful tool for a range of data projects.

  • Load Data from transactional sources into the data lake
  • Load application logs and structured files from a cloud object storage to the data lake
  • Cleanse and transform information inside the data lake
  • Load data from the data lake into the data warehouse

WHO VISUAL FLOW IS FOR

We developed Visual Flow for anyone looking for a convenient, intuitive ETL solution. Whether your data is multiplying faster than your single-server warehouse can process it, or you don’t have access to ETL coders for Spark, Visual Flow is for you.

  • Set up Visual Flow in under 30 minutes
  • Quickly design applications to transform large-scale, semi-structured datasets
  • Turn a messy backlog of data into uniform data lakes and warehouses
  • Intuitive, no-code interface
  • Standalone solution for intuitive ETL
  • Save money and time on training and/or new hires

Contact us

Please fill in the form to get in touch with us and share your details. Feel free to provide any additional information or specific questions you might have. Our team is committed to responding promptly and thoroughly.

Looking forward to hearing from you soon!

[contact-form-7]

The post ETL Tool Visual Flow appeared first on IBA Group - USA.

]]>
IBA Group Builds Global Enterprise Data Warehouse and Provides 24/7 Support https://us.ibagroupit.com/cases/data-warehouse-24-7-support/ Tue, 15 Dec 2020 12:08:07 +0000 https://us.ibagroupit.com/?post_type=cases&p=7073 The post IBA Group Builds Global Enterprise Data Warehouse and Provides 24/7 Support appeared first on IBA Group - USA.

]]>

Business Challenge

Development and support of Enterprise Data Warehouse, ETL processes and web application to process data.

Solution

IBA Group develops a financial planning and forecasting system for customer projects. A web application has been created for project managers to build financial forecasts. They also complete questionnaires and feedback forms used to assign statuses to the projects depending on their possible profitability/loss-making capability. After this data is processed, key performance indicators are generated. The reports generated by the system are submitted for verification to the company management.

A team of 30 developers and 10 technical support specialists is working on the project. They monitor ETL downloads around the clock and respond to user requests.

The system operates in five regions: USA, Asia, Europe, Japan and Latin America. Each region has individual ETL processes configured.

Result

The system generates reports for the company management to determine financial forecasts for the next quarter.

The post IBA Group Builds Global Enterprise Data Warehouse and Provides 24/7 Support appeared first on IBA Group - USA.

]]>
Corporate Data Warehouse for Bank https://us.ibagroupit.com/cases/dwh-bank/ Thu, 23 Jul 2020 11:30:21 +0000 https://us.ibagroupit.com/?post_type=cases&p=5316 The post Corporate Data Warehouse for Bank appeared first on IBA Group - USA.

]]>

Project Overview

The project was implemented to meet the following challenges:

  1. Design and implement a unified data warehouse based on the standard industrial model with a degree of customization up to 30 percent.
  2. Implement the algorithms of data upload from the accounting systems of the bank and external sources to the corporate data warehouse in line with the methodology of managerial accounting. To provide a possibility of performing adjustments.
  3. Implement the approaches of data cleansing and quality control, as well as business rule verification
  4. Build theme–based data marts designed to analyze general ledger data, loan portfolio, managerial accounting, and performance of the network of self–service banking equipment
  5. Implement a business glossary of banking terms
  6. Develop more than 90 scheduled reports covering the tasks of management reporting and reporting to the parent company and regulators.

Solution

IBA is working as a part of the development team. The IBA responsibilities include requirement analysis; application design; database design, application development; unit, functional and system testing; quality assurance; and support.

The first ten stages of the project were finished on time with excellent references from the customer.

The eleventh stage, namely the enhancement of the application is currently underway.

Project Results

The application was deployed to production in line with the schedule. IBA received excellent references from the customer.

The post Corporate Data Warehouse for Bank appeared first on IBA Group - USA.

]]>
Global IT company has automated marketing processes using the Unica platform Business Challenge https://us.ibagroupit.com/cases/it-company-marketing-processes-hcl-unica-platform/ Mon, 08 Jun 2020 14:27:18 +0000 https://us.ibagroupit.com/?post_type=cases&p=6759 The post Global IT company has automated marketing processes using the Unica platform Business Challenge appeared first on IBA Group - USA.

]]>

Business Challenge

Support and internal configuration of Unica-based applications for automating marketing processes, and development of ETL applications to collect data from external systems and transfer them to CRM.

Solution

The IBA Group team includes 20 people. Experts are involved in product configuration; create offer templates, project templates, flowcharts. They also develop database models and all ETL processes, and integrate with CRM systems (Atlas, Gaia, Watson Health).

The customer’s website provides for mandatory sign in for customers seeking advice or downloading promotional materials. All customer information is stored in the database. Data is collected, sorted and sent to external system for verification. If it is an existing client, the system returns the user ID. For new clients it creates new IDs. Subsequently, all marketing campaigns are built based on user IDs.

A marketer can customize flowchart, a business logic that triggers further processes. The system makes a decision on each contact: either to immediately send it to CRM for handling by salesperson, or send e-mail with additional materials about the product of interest for the client.

If a customer wants to run an advertising campaign, it may select the appropriate audience from the database. For example, men over 40 who have recently looked into certain products and currently work in a company with more than 10,000 employees. This audience is used to customize emails or test calls.

Result

The system is optimized to work with the largest number of Unica users in the world. This includes 1200 flowcharts that are simultaneously created by marketers around the world. Round-the-clock system utilization: customer offices are located in India, the USA, Romania, Japan and the Philippines.

The post Global IT company has automated marketing processes using the Unica platform Business Challenge appeared first on IBA Group - USA.

]]>