THE WELCH COMPANY
440 Davis Court #1602
San Francisco, CA 94111-2496
415 781 5700
rodwelch@pacbell.net


S U M M A R Y


DIARY: August 11, 2002 08:58 AM Sunday; Rod Welch

NWO and POIMS changed to sections that fit Medit memory limits.

1...Summary/Objective
2...NWO. Bat Process Sections and Assemble into Single File for Internet
3...02901 Assemble Updated NWO File for Publication on the Web
4...When and where do we call the batch operation?
5...000001 Macro 235 Run 0122 or 070405 to Convert to HTML
6...0608 Mouse Click Recognize NWO POIMS Call Batch Op to Convert
7...070405 Transform SDS Files to HTLM Special Treatment for NWO POIMS
8...0704081 Link NWO POIMS to Editor Files Modify Filename
9...POIMS Create Separate Sections to Fit Memory
10...POIMS.Bat Process Sections and Assemble into Single File for Internet
11...02902 Assemble Updated POIMS File for Publication on the Web


..............
Click here to comment!

CONTACTS 

SUBJECTS
File Too Big for Converting into HTML Segmented into Chapters
NWO File Too Big Will Not Convert Using 0122 into HTML for Transfer t
Memory Failed to Assemble NWO Had to Segment into Sections
NWO Segment File Too Big for Single File Conversion

0806 -
0806 -    ..
0807 - Summary/Objective
0808 -
080801 - Follow up ref SDS 3 0000, ref SDS 1 0000.
080802 -
080803 - POIMS is now about 4000 lines, and NWO is over 5000 lines.  These
080804 - files barely fit in memory.  NWO is too big to convert to HTML, it is
080805 - crashing Medit when processed by 0122.  POIMS still can be converted,
080806 - but regularly runs us out of memory when opened for linking and to
080807 - edit.  So, today, segmented NWO, per below, ref SDS 0 SH4G, and then
080808 - used the same the procedures to segment POIMS. ref SDS 0 WZ5N
080809 -
080810 -       [On 030616 modified code in 02901 and 02902 for converting NWO
080811 -       and POIMS. ref SDS 5 IV6F
080812 -
080813 -
080814 -
080815 -
080816 -
080818 -  ..
0809 -
0810 -
0811 - Progress
0812 -
081201 - The NWO paper has grown to 5,000 lines. ref OF 2 43FD  The conversion
081202 - op using 0122 is failing.  The past few days have been adding some
081203 - analysis, and last night added an explanation of the leadership,
081204 - management science and techhology trilogy that is needed for
081205 - transformation from information to a culture of knowledge.
081207 -  ..
081208 - Conversion using 0122 was working fine, then suddenly failed.  Even
081209 - removing a lot of lines, still would not enable processing the file.
081211 -  ..
081212 - Today I segemented the file based on the following issues...
081213 -
081214 -     1.  How to segment.
081215 -
081216 -         a.  We could divide it in half, and this would solve the
081217 -             problem for the time being.
081219 -              ..
081220 -             The rationale against this is that soon, we will have the
081221 -             same problem.
081222 -             ..
081223 -         b.  We could divide it into quarters, making 4 files,
081224 -             and this would likely be adequate for many years.
081226 -              ..
081227 -         c.  Divide based on chapters, or maybe sections, and this
081228 -             would last forever.
081230 -          ..
081231 -     2.  Do we create a routine to assemble all of the elements after
081232 -         conversion to HTML into a file 0309?
081234 -          ..
081235 -         The advantage is that all of the existing links, including
081236 -         internal links remain in tact.
081238 -          ..
081239 -         Or, do we convert all internal links, plus all links in other
081240 -         documents and SDS records.
081241 -
081242 -             This is likely a two (2) day job, working 24 7, i.e.,
081243 -             actually a normal 6 days worth of work.
081244 -
081246 -  ..
081247 - Dividing into sections, could be along the following lines...
081248 -
081249 -     1.  New World Order Makes Communication Biggest Risk Enterprise,
081250 -         ref OF 8 0001  - 1,300 lines, ref OF 9 0001
081251 -         ..
081252 -     2.  Communication Metrics New Science Bridges Cognition and
081253 -         Technology into New Management Science, ref OF 8 2864 - line
081254 -         1300, 1,500 lines, ref OF 10 AR4K
081256 -          ..
081257 -     3.  From Law and Religion to Culture of Knowledge. ref OF 8 4723 -
081258 -         line 2800, 600 lines, ref OF 11 AR4K
081260 -          ..
081261 -     4.  Leadership and Technology, ref OF 8 4305, - line 3400, 1,300
081262 -         lines, ref OF 12 AR4K
081264 -          ..
081265 -     5.  Transformation to Culture of Knolwedge. ref OF 8 7055 - line
081266 -         4700 - 300 lines, ref OF 13 AR4K
081267 -
081268 -                   1300
081269 -                   1500
081270 -                    600
081271 -                   1300
081272 -                    300
081273 -                ---------
081274 -                   4900
081276 -  ..
081277 - For the time being, we can convert these files individually, and then
081278 - glue them together and save to the file....
081279 -
081280 -
081281 -                  0309.htm
081282 -
081284 -  ..
081285 - This saves investing the time to convert all of the links to apply
081286 - the new structure.
081288 -  ..
081289 - It presents a danger of having to convert all of the files each pass
081290 - and connect them together each time 0309 is linked in the record.
081291 -
081292 -     We can solve this somewhat by creating a method to assemble the
081293 -     files for each section into a new 0309 file.
081295 -      ..
081296 -     We also have to modify 070405 to read each section file as the
081297 -     0309 file, since the section files are not being put on the
081298 -     Internet at this time. ref SDS 0 1Q3F
081300 -  ..
081301 - We have the same considerations for POIMS.
081303 -  ..
081304 - Let's initially try creating...
081305 -
081306 -                     c: 01 02 nwo.bat
081307 -
081308 -                     c: 01 02 poims.bat
081309 -  ..
081310 - This should create the following...
081311 -
081312 -        f: 03 00050 01 09 03 02 03 0309
081313 -
081314 -        c: sd wl 03 00050 01 09 03 02 03 0309.htm
081315 -
081316 -        c: sd wt 03 00050 01 09 03 02 03 0309.htm
081317 -
081318 - ...and...
081319 -
081320 -        f: 03 00050 01 09 01 02 00030
081322 -         ..
081323 -        c: sd wl 03 00050 01 09 01 02 00030.htm
081325 -         ..
081326 -        c: sd wt 03 00050 01 09 01 02 00030.htm
081327 -
081329 -  ..
081330 - NWO. Bat  Process Sections and Assemble into Single File for Internet
081331 -
081332 -
081333 - Line 30, ref OF 15 EF5L in nwo.bat
081334 -
081335 -     6.
081336 -    cd\sd\10
081337 -
081338 -       Do the work on c: in sd 10.
081340 -     ..
081341 -    del funn
081342 -
081343 -       Remove temp file each pass in case someone creates funn
081345 -     ..
081346 -    c:\sd\01\e funn c:\sd\03\02901
081347 -
081348 -       Process funn with 02901, per below, ref SDS 0 F46I, to
081349 -       create section files with HTML
081351 -     ..
081352 -    del f:\03\00050\01\09\03\02\03\0309
081353 -
081354 -       Remove the full file for 0309, because it will be re-built to
081355 -       ensure that changes in the sections are incorporated into the
081356 -       new file.
081358 -  ..
081359 - Line 50 ref OF 15 J134 in nwo.bat
081360 -
081361 -    copy f:\03\00050\01\09\03\02\03\0309A 0309IA > nul
081362 -
081363 -       Copy the first section to local directory for copying into a
081364 -       new version of 0309, since it does not need to have the
081366 -  ..
081367 - Line 70, ref OF 15 T554, in now.bat
081368 -
081369 -    copy 0309ia+0309ib+0309ic+0309id+0309ie f:\03\00050\01\09\03\02\03\0309 > nul
081370 -
081371 -       Copy individual sections created by 02901 processing into a new
081372 -       0309 file.  This is only used in case someone wants to look at
081373 -       the whole thing.  We might be bettter off not creating this
081374 -       file, but will try it for now.
081376 -     ..
081377 -    del 0309i*
081378 -
081379 -       Delete the individual pieces used to build back 0309.
081381 -  ..
081382 - Line 80, ref OF 15 5667, in nwo.bat
081383 -
081384 -    cd \sd\wl\03\00050\01\09\03\02\03
081385 -    del 0309*.HTM
081386 -
081387 -       Change to the wl local web directory for the 0309 file, and
081388 -       delete any existing files for 0309.
081390 -  ..
081391 - Line 90, ref OF 15 55E6, in nwo.bat
081392 -
081393 -    copy A309IA+A309IB+A309IC+A309ID+A309IE 0309.HTM > nul
081394 -
081395 -       Copy the separate 0309 files created by 02901 with HTML, into a
081396 -       new file 0309.htm for local viewing of what is on the Internet.
081398 -     ..
081399 -    del A309i*
081400 -
081401 -       Delete individual sections, since the are replaced by the
081402 -       larger file.
081404 -  ..
081405 - Line 100, ref OF 15 J688, in nwo.bat
081406 -
081407 -    cd \sd\wt\03\00050\01\09\03\02\03
081408 -    del 0309*.HTM
081409 -
081410 -       Change directory to wt transfer directory, and delete any
081411 -       existing 0309 files that may have been created previously.
081413 -  ..
081414 - Line 110, ref OF 15 I589, in nwo.bat
081415 -
081416 -    copy A309IA+A309IB+A309IC+A309ID+A309IE 0309.HTM > nul
081417 -
081418 -       Copy the separate 0309 files created by 02901 with HTML, into a
081419 -       new file 0309.htm for transfer to the Internet.
081421 -     ..
081422 -    del A309i*
081423 -
081424 -       Delete individual sections created by 02901 since they are now
081425 -       replaced by the single large file.
081426 -
081427 -
081429 -  ..
081430 - 02901  Assemble Updated NWO File for Publication on the Web
081431 -
081432 -
081433 - Line 30, ref OF 16 VV6H,
081434 -
081435 - Created macro to remove the headers from each section file.
081436 -
081437 -        c: 01 04 02901
081438 -
081439 -           [On 030616 created 02902 for POIMS. ref SDS 5 2K9L
081441 -            ..
081442 -           [On 040626 created 02093 to support ASB file that sets
081443 -           standard for SDS at Aerospace company. ref SDS 6 IV6F
081445 -     ..
081446 -    This routine will....
081447 -
081448 -       1.  Convert each of the section files to HTML so that conversion
081449 -           stays in sync for the total file. ref OF 17 SQ7H
081451 -            ..
081452 -           Call macro 0122 in a subroutine to process each of the file
081453 -           segments. ref OF 17 TH6L
081454 -           ..
081455 -       2.  Read in each original section file, 0309b-e, starting
081456 -           with b, because file A does not need to be modified.
081457 -           ref OF 17 ER6O
081459 -            ..
081460 -       3.  We are creating a header in each file for a future condition
081461 -           where we actually convert to using separate files.
081463 -            ..
081464 -           Need to remove this section at the top of all of the files
081465 -           for b - e.
081467 -            ..
081468 -           Created a routine. ref OF 17 JC5N
081470 -            ..
081471 -       4.  Remove the end commands for body and html. ref OF 17 GM4O
081472 -
081473 -           Line 220, ref OF 17 0Q3G,
081474 -
081475 -               Omit removing ending HTML for last segment, since this
081476 -               is needed.
081477 -
081479 -  ..
081480 - When and where do we call the batch operation?
081481 - 000001  Macro 235 Run 0122 or 070405 to Convert to HTML
081482 -
081483 -
081484 -     Maybe we can do it when we convert an 0309 file into HTML.
081485 -
081486 -     We need to recognize when 0309 is being processed, and at that
081487 -     time, run the batch op under 0122.
081489 -      ..
081490 -     00001 line 1280 macro 235 was modified. ref OF 22 NW9H
081491 -
081492 -        It already uses gfname, so use this to test for the 0309 file,
081493 -        and it that file has been opened, and error message says to
081494 -        open the section files. ref OF 22 124L
081495 -
081496 -           [On 021025 the code for macro 235 was ported to macro file
081497 -           0608 to save compiler space. ref SDS 4 0453
081499 -         ..
081500 -        If any of the section files are opened, then the nwo.bat
081501 -        routine is called to process all sections so that the version
081502 -        sent to the web remains in sync with the lastest changes in any
081503 -        of the section files.
081504 -
081506 -      ..
081507 -     We need a mechanism to identify the NWO file to avoid saving it,
081508 -     rather than the section files, since 0309 is build new each time a
081509 -     section file is converted to HTML.
081511 -      ..
081512 -     Unfortunately, we don't have a mechanism for this because F2 is
081513 -     just assigned to save.  There is no code to edit.
081515 -  ..
081516 - 0608  Mouse Click Recognize NWO POIMS Call Batch Op to Convert
081517 -
081518 - Per above, on 021025 code in 00001 for macro 235, ref SDS 0 RU8M, was
081519 - transferred to 0608 to save compiler space, ref SDS 4 0453
081520 -
081521 - Therefore, explanation of 0608 is provided here for clarity to
081522 - understand how the code manages recognition of NWO and POIMS based on
081523 - clicking the mouse for HTML conversion, or calling the menu op for
081524 - HTML conversion, so there is not a separate process for handling NWO
081525 - and POIMS.
081527 -  ..
081528 - Line 320, ref OF 19 773G, -label 0122C in 0608 about 30 lines below
081529 -
081530 -    gfname
081531 -
081532 -       When the mouse is clicked macro 80 calls macro 0608 based on
081533 -       recognizing the click was above Quit=ESC.  gfname reads the
081534 -       filename for processing.
081536 -        ..
081537 -       There are conditionals for recognizing SDS development files,
081538 -       which are not processed for HTML.
081540 -     ..
081541 -    setcnt 147 0
081542 -
081543 -       Set flag to distinguish between NWO and POIMS files, as shown
081544 -       below. ref SDS 0 FT7F
081546 -     ..
081547 -               9            0            3            0
081548 -    -if @31 = 57 -if @30 = 48 -if @29 = 51 -if @28 = 48 -goto nwoJ
081549 -
081550 -        This says that if the end of the string is 0309, then go
081551 -        test further to determine if it is actually the NWO file.
081552 -
081553 -        If it is not 0309, then test for 0030
081555 -     ..
081556 -               0            3            0            0
081557 -
081558 -    -if @29 = 48 -if @28 = 51 -if @27 = 48 -if @26 = 48 -goto poims
081559 -
081560 -        If this is 0030, it could be 00030, so go test further for the
081561 -        POIMS file.
081562 -
081563 -    -goto nnwo
081564 -
081565 -        The conditionals determined the file is neither NWO nor POIMS
081566 -        so go process to convert to HTML.
081568 -  ..
081569 - Line 330, ref OF 19 124L, -label nwoJ in 0608
081570 -
081571 -               /            3            0            /
081572 -    -if @27 = 92 -if @26 = 51 -if @25 = 48 -if @24 = 92 -goto nwok
081573 -
081574 -        If the next part of the filename and path aligns with NWO path
081575 -        and filename, then go and run the batch file that converts the
081576 -        five (5) sections of the NWO paper and assemble the separate
081577 -        sections into a single HTML file for publication.
081578 -
081579 -    -goto nnwo
081580 -
081581 -        This says it is not NWO, so go use the standard process to
081582 -        convert the file into HTML.
081584 -  ..
081585 - Line 340, ref OF 19 K14K, -label poims in 0608
081586 -
081587 -               0            \            2            0           \
081588 -    -if @25 = 48 -if @24 = 92 -if @23 = 50 -if @22 = 48 -if @21 = 92 -goto pwok
081589 -
081590 -        If the next part of the filename and path aligns with POIMS
081591 -        path and filename, then go and run the batch file that converts
081592 -        the five (5) sections of the POIMS paper and assemble the
081593 -        separate sections into a single HTML file for publication.
081594 -
081595 -    -goto nnwo
081596 -
081597 -        This says it is not NWO, so go use the standard process to
081598 -        convert the file into HTML.
081600 -  ..
081601 - Line 350, ref OF 19 VG5J, -label pwok in 0608
081602 -
081603 -    setcnt 147 1
081604 -
081605 -       The code has established that POIMS is being converted to HTML.
081606 -       Set flag that POIMS is being processed rather than NWO, by
081607 -       changing counter 1 from 0 that was set at the beginning of the
081608 -       process, ref SDS 0 A27I, to 1, for use below. ref SDS 0 FT7F
081610 -  ..
081611 - Line 360, ref OF 19 AJ6J, -label nwok in 0608
081612 -
081613 -       The code now knows that either NWO or POIMS is being converted
081614 -       to HTML.
081615 -
081616 -    -gosub mtd1
081617 -
081618 -       Maintain transfer directory in advance of converting files to
081619 -       HTML.  We could probably do this earlier in the code, but
081620 -       things seem to be working for now.
081622 -     ..
081623 -    -if @147 = 0 -if @32 = 0 -goto erNWo
081624 -
081625 -       Counter 32 = 0 from gfname command, if this is processing the
081626 -       0309 file, rather than a section file which will be 0309a,
081627 -       0309b, etc.  So if a section file is being processed, for NWO,
081628 -       then counter 32 is not 0
081630 -     ..
081631 -    -if @147 = 1 -if @30 = 0 -goto erNWo
081632 -
081633 -       Counter 30 = 0 from gfname command, if this is processing the
081634 -       00030 file, rather than a section file which will be 00030a,
081635 -       00030b, etc.  So if a section file is being processed, for
081636 -       POIMS, then counter 30 is not 0 because the path is shorter for
081637 -       POIMS than for NWO.
081639 -  ..
081640 - Line 380, ref OF 19 HV8O, -label nwok in 0608
081641 -
081642 -    -if @147 = 0 dose /c C:\01\02\NWO.BAT
081643 -    -if @147 = 1 dose /c C:\01\02\POIMS.BAT
081644 -
081645 -       The code above has determined this is not a full NWO or POIMS
081646 -       file, so it must be processing a section file, and therefore
081647 -       processing allowed.  If it is NWO, run a batch file to convert
081648 -       the section files using macro file 0122, and assemble then into
081649 -       a single nwo file for transfer to the Internet.  If it is POIMS
081650 -       do the same tasks for the POIMS section files, based on flags
081651 -       set above. ref SDS 0 A27I
081653 -        ..
081654 -       We need a rule that only section files can be processed into
081655 -       HTML so we do not fall into a practice of editig the main file
081656 -       and get the sections out sync with the main file.
081658 -     ..
081659 -    -if @147 = 0 errormsg  NWO section files converted to HTML
081660 -    -if @147 = 1 errormsg  POIMS section files converted to HTML
081661 -
081662 -       Return a message after conversion showing the section files
081663 -       were successfully processed.
081664 -
081665 -
081666 -
081667 -
0817 -

SUBJECTS
POIMS Foundational Documents Links in SDS Records 070405 Convert Mul
NWO Foundational Documents Links in SDS Records 070405 Convert Multi

1004 -
100501 -  ..
100502 - 070405  Transform SDS Files to HTLM Special Treatment for NWO POIMS
100503 -
100504 -
100505 -     We need a mechanism to convert assignments to NWO, 0309A-E in
100506 -     macro 070405 to just file 0309 on the Internet, and similarly for
100507 -     POIMS, 00030A-E, since that is what we are building.
100508 -
100509 -         [On 040714 created general application to support SDS
100510 -         foundational documents, NWO and POIMS, plus ASB for submitting
100511 -         SDS as a standard at Aerospace company, and further to manage other files
100512 -         that may be segmented for better memory management.
100513 -         ref SDS 7 TP3J
100515 -      ..
100516 -     We could begin going forward using multiple files.  This would
100517 -     require sending both the main files for NWO, 0309 and and POIMS,
100518 -     00030 and the individual section files to the Internet.  Right now
100519 -     we are wired to just send only NWO, 0309, and POIMS, 00030.
100521 -  ..
100522 - Line 1850, ref OF 20 673L, -label 070405_2
100523 -
100524 -     This is where the main process begins for creating links into the
100525 -     record.
100527 -  ..
100528 - Line 2450, ref OF 20 124L, -label cRecd
100529 -
100530 -     The target filename is created at this point using macro 1181, so
100531 -     we can use the same procedure developed in macro file 0608, per
100532 -     above. ref SDS 0 O68G
100533 -
100534 -         [On 040714 all of the code today was deleted to create a
100535 -         general application to support SDS foundational documents, NWO
100536 -         and POIMS, plus ASB for submitting SDS as a standard at
100537 -         Aerospace company, and further to manage other files that may be
100538 -         segmented for better memory management. ref SDS 7 TP3J
100539 -
100541 -  ..
100542 - Line 2470, ref OF 20 124L, -label cRecd in 070405 about 50 lines
100543 - below
100544 -
100545 -     Determine if this is the NWO file 0309, or the POIMS file 00030,
100546 -     and if so, then if the value read by macro 1182 after the end of
100547 -     the filename either 0309 or 00030, is not 0, a section idenfifier,
100548 -     A-E or a-e, has been entered.
100550 -  ..
100551 - Line 2510, ref OF 20 J78H, -label nw3 in 070405
100552 -
100553 -     Remove the section identification for 00030 and 0309, so the links
100554 -     will work on the Internet.  We do not need section identifiers on
100555 -     the Internet and for the local Internet record set, because
100556 -     browser technology can handle more than 640K of memory, which is
100557 -     the purpose of the sections.
100558 -
100559 -
100561 -  ..
100562 - 0704081  Link NWO POIMS to Editor Files Modify Filename
100563 -
100564 - Follow up ref SDS 2 9222.
100565 -
100566 - Similar to changes in 070405 we need to identify when NWO and POIMS
100567 - are being linked to an editor file for writing a letter or other
100568 - document, and remove the section character at the end of the filename
100569 - if a section file is being processed.
100571 -  ..
100572 - We also have to avoid saving the original file file for NWO and
100573 - POIMS, so we do not get the section files out of snyc.
100575 -  ..
100576 - Line 340, ref OF 21 124L, -label skPrg in 0704081
100577 -
100578 -     Use same code as for 070405. ref SDS 0 PURW
100579 -
100581 -  ..
100582 - Line 390, ref OF 21 J78H, -label nw3 in 0704081
100583 -
100584 -     If POIMS or NWO back up and remove section identifier, per above.
100585 -     ref SDS 0 WN6K
100586 -
100587 -
100588 -
100589 -
100590 -
100591 -
100592 -
100593 -
100594 -
1006 -

SUBJECTS
POIMS File Too Big Crashing Often When Opening to Link
File Too Big for Converting into HTML Segmented into Chapters
POIMS Segment File Too Big for Single File Conversion
POIMS Assemble Pieces Convert to HTML for Transfer to Internet

1406 -
140701 -  ..
140702 - POIMS Create Separate Sections to Fit Memory
140703 -
140704 - This essentially replicates the same procedures and for the same
140705 - reasons that were developed for segmenting the nwo paper, per above.
140706 - ref SDS 0 839G
140707 -
140708 - Divided POIMS as follows...
140710 -               ..
140711 -              POIMS......................  800
140712 -              False Knowledge............  875
140713 -              Limits of Technology.......  799
140714 -              Integrated Management......  729
140715 -              Think, Remember, Comm......  825
140717 -               ..
140718 -              Total lines...............  3886
140719 -
140721 -  ..
140722 - POIMS.Bat Process Sections and Assemble into Single File for Internet
140723 -
140724 - This works the same way as nwo.bat, per above. ref SDS 0 WG5G
140725 -
140727 -  ..
140728 - 02902  Assemble Updated POIMS File for Publication on the Web
140729 -
140730 -
140731 - Line 30, ref OF 18 VV6H,
140733 -  ..
140734 - Created macro 02092 to work like 02901 processes NWO. ref SDS 0 F46I
140735 -
140736 -
140737 -
140738 -
140739 -
140740 -
140741 -
140742 -
140743 -
140744 -
140745 -
140746 -
140747 -
1408 -