PDS2PDS Partitioned Dataset Matching Utility

Still no News to Report

2009-01-01T20:25:00.000-08:00

Unfortunately I haven't really worked on the utility at all since the beginning of 2008. I have taken some time to document some of the new features I want to add, but no coding has been done on anything in almost a year.

My regular job has taken up enough of my time that I just haven't been able to concentrate on this software. I have, however, as part of my regular job learned quite a bit about writing Open API and Open TCB programs in CICS.

Right now I can't say when I'll be able to start working on the utility again. I'm going to need to learn some new (for me) ISPF tricks for using Dynamic Areas in ISPF panels to implement some of the features I want to add.

It's been a while

2008-06-08T06:43:00.000-07:00

So, it's been about four months since the last time I really did any work on the utility. Looking at the source code after all this time is almost like seeing it for the first time. I re-tested the functions that currently exist just to make sure I hadn't left anything broken or non-working from before, and realized that I had omitted a couple of things.

I'm in the process of adding in the omissions but I haven't found any problems. One other thing I need to add before the program gets too big is some sort of logging. I'm thinking that a record of each session, showing things like members moved, deleted, copied, etc. might come in handy if members in one dataset or the other were accidentally altered or destroyed.

Slow progress this past week

2008-02-05T17:24:00.001-08:00

Things have been a little slow this past week. I'm (still) working on two commands, Copy and Synchronize.

The first version of the Synchronize just didn't work well at all, so I've rewritten it. I also wrote new code for reporting errors. Now a panel is displayed after an error that tells the paragraph name the error occurred in, the operation that got the error, the dataset names involved, and information from the ZERRSM and ZERRLM variables. All of the new code seems to be working well and I'm doing testing right now.

The Copy command was working fine but the program calls IKJEFTSR to execute TSO commands. In case of errors in TSO commands you usually get error messages displayed on the screen. But I trap screen output to a compound variable using OUTTRAP and i want to read those variables and display the messages in the new error message panel. After a lot of fumbling around I finally figured out I could just VCOPY the terminal output variables into the program and report them.

So now I'm testing the new code and by the end of the week I hope to move on to the next thing.

Primary Commands Under Development

2008-01-31T17:39:00.000-08:00

Most of the primary commands are written: Locate, Flip, Copy, and Synchronize. But after I got the Synchronize command written I decided I didn't like the way it works, so I'm re-writing it. After that, I'll work on the Swap command.

I've added about a thousand lines of code to the program in just the last week. That's not as dramatic as it sounds because once a section of code is written for the dataset displayed on one side of the screen I can just duplicate that code for the other dataset and change some of the field names.

So things are still progressing, but starting to slow down a bit.

A Milestone reached today

2008-01-22T18:53:00.000-08:00

Today I reached a milestone of sorts. All of the work up to now has been on the basic operation of the main and member list panels: validation of datasets, error detection and recovery, display of proper PDS directory information for both "source" and load module datasets, and proper operation of the fields that select which members of the datasets are displayed. So far five programs have been written (3 COBOL and 2 Assembler) for a total of about 3500 lines of code. There's also a couple of hundred lines of REXX code for validation of panel fields and other things.

After some final desk checking, tweaking of panels, changes to programs, and testing of the code thus far, I'm finally ready to declare this phase finished and move on to the next.

The next phase is to start writing code to execute the various commands. There are primary commands which are entered on the ISPF command line, what I call global commands that operate on the entire dataset(s), and line commands which operate on individual member or member pairs.

The primary commands will be written first, then the global commands, and finally the line commands. I keep thinking of new commands I want to add, so these are a moving target for now.

Below are current screen images of the main and member list panels.

The main panel:

The Member List Panel:

Load Module info now on member list panel

2008-01-20T10:18:00.000-08:00

Today I modified the programs and member list panel so they would display the PDS directory information for load modules. The new assembler language subroutine that I finished a couple of days ago interprets this information and passes it back to the main program, and now the main program will show this information on the member list panel.

Another subroutine completed

2008-01-16T19:21:00.000-08:00

Today I finished another Assembler language subroutine. This one interprets the PDS directory information for load modules.

So the next task is to modify the member list panel to display these. Then I have to finish the Help panels, and then I may be close to being able to start writing the code that executes the global and line commands. It seems like every time I get close to this point I remember something else that hasn't been done yet.

Forgot about the Help Panels

2008-01-07T17:17:00.000-08:00

As I was finishing up last night it hit me that I hadn't started working on the ISPF Help Panels yet. So now I have all of the help panels finished for all of the parts that work. I'll add the remaining help panels as the code is written for those functions.

I also restructured the User Guide this afternoon to improve its appearance. So I'll spend the rest of this week tidying up everything that's been done up to now, and next week I hope to start coding for the various commands.

Lots More Progress

2008-01-06T11:46:00.000-08:00

Lots more progress made last night and today. I've added documentation and comments into each COBOL program and REXX exec for things like program purpose, contact information for the author, who calls the program, who does the program call, etc.

I added the 'LOCATE' primary command to the member list panel for locating specific members in the display.

I moved the in-line REXX code from the panels to the REXX library. There are four panels, so each REXX program was duplicated four times. Each time the code changed, I had to change it in four places. Now all of the REXX code is in the REXX library and only has to be changed once.

I'm very close to wrapping up this phase of development and moving on to adding the code for the Global and Line commands.

ISPF Panels Almost Finalized

2008-01-05T15:47:00.000-08:00

I think I'm finished tinkering with the appearance of the ISPF member display panels. The 80-column panel was tough, because there just isn't enough room to show all the information at one time that I'd like. But I fooled with it enough to create something that I think will work.

Earlier versions of the utility only showed the statistics information for source datasets but not for load libraries. I found some documentation that may explain how to decode this information for load modules. If so, I hope to be able to display this information for load libraries.

One idea I'm thinking about is whether to allow users to change the statistics information for source-type pds members. There is an ISPF service that will do this. All I have to do is display the statistics data in input fields and allow the user to change it. But I'm not sure yet if I want to do that. One idea would be to provide a pull-down menu at the top of the panel for Options. One of the options could be to display the statistics data in input or display-only fields. I've also thought of a couple of other options that might be useful.

LE Callable Services vs. Assembler

2008-01-03T15:29:00.000-08:00

The main program has a need to acquire storage in memory to store the member lists of the two datasets that are being compared. I used the LE Callable Services CEECRHP, CEEGTST, and CEEDSHP to acquire and release storage. These services are fairly easy to use but it just seemed like a lot of code to write to accomplish such a trivial task.

So I took all of that code out and instead I wrote an Assembler language program to invoke the GETMAIN and FREEMAIN macros directly to manage the needed storage. The new program source code is less than 100 lines long and the load module is around 500 bytes in size. I just use a static call to compile and link it in with the main program. The main program calls the new Assembler module to to all GETMAINs and FREEMAINs.

The source code for the main program is about a hundred lines smaller than it was when coded to call the LE services.

Development Envrionment for PDS2PDS

2007-12-22T07:24:00.000-08:00

Here are the levels of the various software products used to develop PDS2PDS:

z/OS 01.09.00
TSO/E Level: 3.9.0
ISPF Level: 5.9 PDF 5.9
LE Version: 1.9.0
PP 5655-G53 IBM Enterprise COBOL for z/OS 3.4.1

Today I started writing the documentation for the utility. So far there are three chapters: An introduction, a description of the installation package contents, and the installation instructions. The document will obviously be revised as development proceeds.

Added Validation of ISPF Panel Fields

2007-12-21T09:47:00.000-08:00

I've added code to the ISPF panels and the main COBOL program to edit and validate the Global and Line command fields. Making sure that only one command at a time is entered, that kind of thing.

PDS2PDS Version 4 Under Way

2007-12-18T11:05:00.000-08:00

I don't know if anyone remembers (or cares) but between 1996 and 1999 I wrote a utility called PDS2PDS for IBM ISPF under MVS.

It hasn't been changed or updated since sometime in 1999. Lately I got the idea to completely rewrite it. Version 4 will be written in Enterprise COBOL rather than REXX. It will have the ability to display using 132-column panels as well as 80-column panels, but trust me, you'll want to use the wide display.

Since the rewrite project is just beginning I decided to post progress reports here.

Current status:

The main REXX exec that issues the LIBDEF and TSOLIB commands to establish the working environment is written.

The main and member display panels are written, although some work still needs to be done on the 80-column member list display panel.

The main COBOL program is written. This program displays and processes the main and member list panels and will either execute or call programs to execute the global and line commands entered by the user. I haven't decided yet which way to go with that.

I'm reusing two COBOL programs from the previous version of PDS2PDS. I've just made minor changes to the program that reads the PDS directories and the one that builds the ISPF table displayed on the member list panel.

New Features:

Here is a partial list of new features for Version 4:

Uses 132-column display as well as 80-column display.
Has a PROMPT field that lets the user enter a new member name for copy, move, and rename commands - this field will also be used to show results of commands.
Allows the user to modify the dataset name, member matching parameters, and the Include/Exclude flag on the member list display.
Will have at least one new global and line command called Swap, which will swap members between datasets

I'm toying with the idea of creating a simple way for users to add their own global and line commands to the utility, but I haven't given it too much thought just yet.

There's much to do. I haven't written any code yet to implement any of the global or line commands, none of the help panels are written, and I'm still deciding about features that I may or may not add to the utility. So it will be months before anything is released, but I plan to post progress updates here on a semi-regular basis.

Here are some screen shots of the main and member list panels as they look today: