Tuesday, May 26, 2009

moved ekkes-corner blog to wordpress

Last days I moved my blog "ekkes-corner" from Blogger to Wordpress. I was impressed how easy all my existing blog entries and comments are imported. Some are looking not exactly the same as before, but over all it worked great.

All my new blogs will now be there at Wordpress - hopefully the Feed of Planet Eclipse will be updated soon.

Eclipse 3.5 (Galileo) is coming - and its a good idea for you to become a Friend of Eclipse

Many new cool things in the area of PDE, Target Platforms, Runtime, Riena, Modeling (EMF, oAW) - I'll report about my experiences and give some tips and tricks in my upcoming blog posts.

stay tuned...

ekke

Monday, May 11, 2009

New Ways Around Generation Gap Pattern - VideoCast

To demonstrate the use of VetoRedirectStrategy in oAW workflows (see my last blog entry "New Ways Around Generation Gap Pattern") I created a videocast - movie.

After publishing my first videocasts I learned that there are sometimes problems to play them in different browsers. So I publish my screencasts in different formats - you can use what fits your environment.


Have fun.

ekke

Tuesday, May 5, 2009

New Ways Around Generation Gap Pattern

This blog dsescribes some new ways around "Generation Gap Pattern (John Vlissides)".

ModelDrivenSoftwareDevelopment (MDSD) - Best Practices

Some best practises are valid at all MDSD projects:

  • generated code should be clearly separated from manually written code
  • generated code should not checked into a VersionControlSystem (CVS, SVN, GiT)

Inside a MDSD (ModelDrivenSoftwareDevelopment) project there are different types of code (see also Heiko Behrens article)

Manuelly written code

Code never be generated, always manually written. This can be some base framework classes or code only used at some places not worth to generate like Utility- or Helper classes.

Generated unchanged code

Such code will be always generated and never changed manually. Classes will be re.generated at each run of the generator - existing files are overwritten or destroyed before.

Generated but editable code

This is code where its useful or ecpected that the generated code will be changed or extended. If files exist, they will not be overwritten - new files will be added and generated first time. (generate-once)

Generation Gap Pattern

The main problem with generated code is always how to combine or separate generated code and manually changed / extended code. That's the point where in most cases the Generation Gap Pattern will be used:

Generated classes will be generated into a directory which is cleared before generation. Subclasses will only generated first time into another directory where they can be changed.

In practise some problems happen - per ex. "Ghost Classes" after refactorings / renaming. Also you cannot differ between generated and changed Subclasses - so all will be checked into VersionControlSystem.

To make this more practicable, Heiko Behrens describes „Conditional Generation“ where generated and changed Classes are clearly separated. oAW Workflow can use a "Vetostrategy": Before generating an artifact it will be tested if there's already a changed artifact into another direcrtory - and if found no new generation happens.

This is described in detail in Heiko Behrens article „Generation Gap Pattern“. If you dont have read this article, please do now. I expect that you know the VetoStrategies described by Heiko !

Thanks to Heiko Behrens I got the information about oAW „VetoStrategy“ which was new for me - never read about it in the docs or forum. Now I was inspired to find some solutions for my project better then previous workarounds.

At first I must say, that I have some problems to use the „Generation Gap Pattern“ as generic pattern if generated code also has to be modified in MDSD projects. Working as softwarearchitect and designing an entity model (esp. in the domain of Enterprise Business Applications), I very carefully think about inheritance strategies / hierarchies. (esp. if all must be mapped from Hibernate or EclipseLink to a database)

A really simple inheritance:


If you follow the „Generation Gap Pattern (John Vlissides)“ :
Image from „Generation Gap Pattern“ (c) 1996 John Vlissides

... separating Classes into one generated (often abstract) Class and one additional (often first-time-generated) editable Subclass ...
use of generation Gap Pattern in many oAW projects

... then the inheritance - hierarchy becomes "dirty" from my point of view. In big projects suddenly hundreds of classes are "twice" - and the only reason is technically: because its a modeldriven project ?

I only want to use abstract / concrete classes or super- / subclasses if I need them from my use-cases or software architecture, but not because I'm using a generator - framework.

As always using a pattern you should ask: is it the right pattern or are there other ways to reach the goal ?

From my opinion: the "Generation Gap Pattern" helps in many cases, but not always. Heiko Behrens shows how the use of "VetoStrategies" in oAW workflows will help handling the files and folders, but its no solution to avoid getting many classes twice which bloats the architecture.

Protected Areas

So we again have to find an answer how to separate generated and manually written code without breaking the rules of best practises in MDSD projects.

There is another way: „ProtectedAreas“. STOP crying ;-) please read ahead - I try to use protected areas something different then normaly !

What are „Protected Areas“ ?

If there are some parts of the code where its allowed to modify or extend, then the Begin and the End are marked as special comments identified by an unique ID. Inside these protected areas the default code will be generated and the area will be marked as DISABLED, so if regenerating it will be overwritten.

If a developer modifies / extends the content af a protected region, then this region has to be ENABLED and the changes are protected after regeneration. Using „Protected Areas“ the structure and inheritance of your classes remain unchanged - exact the same as using it without a generator.

How are „Protected Areas“ normaly used ?


Whats the drawback ?

Now classes have protected areas, can be overwritten if regenerated but then they will be checked into VersionControlSystem - thats bad, because there are many classes without changes: only generated content. That breaks the rule "never check-in generated code".

Also you dont see which classes have changes and which are untouched after generation.

Protected Regions using VetoRedirectStrategie

Here's my solution

  • at start of generator-workflow clear „src-gen“ and „veto
  • generator scannes „src-gen-pr“ and caches ENABLED ProtectedAreas
  • „only-generated“ classes will be generated into „src-gen“, also classes with „ProtectedRegions“ without a veto
  • classes with ENABLED „ProtectedRegions“ are stored in „src-gen-pr
  • while generating the generator checks using "VetoStrategy" if a class is already in „src-gen-pr“. If found, then the generated output is redirected into „veto“ directory where the new generated class together with ENABLED ProtectedRegions (from cache) is written to
  • as last step of generation the files from „veto“ are compared with corresponding files from „src-gen-pr“. Only if they differ, the new ones will be copied into „src-gen-pr“. Now we are sure only really changed files will get a new modified flag and checked into VCS.

The Workflow


Generated-only and manually changed code now is clearly separated. Only changed artifacts will be commited into VCS and the Inheritance structure is unchanged.

Of course I have to watch, that a developer changing „Protected Regions“ doesnt forget to activate them (ENABLED) and to move the file into „src-gen-pr“ if not already there.
If you want to check if a developer ENABLED a protected region, but forgets to move into „src-gen-pr“ you simply can add a step at start of your workflow: scan „src-gen-pr“ for protected regions - if some enabled are found, stop workflow with warning.
If you want to check if a developer forgots to enable a protected region after making some changes, you can include something like a checksum into the region and write a component to test these before starting to generate.
All is possible you see - but its of course a matter of time: each extra step will slowdown generation performance.
(Tip: sometimes the Local History of Eclipse helps - but there's currently a bug: oAW generator overwrites the last Local History entry instead of inserting a new)

Inside the default code of a „ProtectedRegion“ I always insert a comment like:

Disabled Protected Region:

Enabled Protected Region:

Some Tech Infos HowTo implement a RedirectVetostrategie

tested using:
  • Eclipse 3.5M6
  • openArchitectureWare 4.3.1 (If you already use the plugins from Eclipse Modeling Project you have to change the namespace)
  • Apache Commons IO 1.4 (SpringSourceEnterpriseBundleRepository - (Eclipse Orbit only has version 1.3.2 from 2007)

Workflow Components

Workflow Component Directory Cleaner (oAW Component)
outlet.src.dir points to src-gen,
outlet.veto.pr.dir points to veto.

Workflow Component Outlet with Vetostrategy (Redirect of enabled ProtectedRegions)

This Outlet uses a new Vetostrategy - also the Outlet Class was extended
outlet.src.dir points to src-gen,
outlet.src.pr.dir points to src-gen-pr and
outlet.veto.pr.dir points to veto.

Workflow Component „fileReplacer“ (Replace files from src-gen-pr ?)

A new Workflow Component compares corresponding files in veto directory and src-gen-pr directory and replaces modified ones.

A short view inside the new Classes and Interfaces

Class OutletWithVetoRedirection (extends oAW Outlet)

Interface VetoRedirectStrategy (extends oAW VetoStrategy)
vetoRedirectSourcePath points to src-gen,
vetoRedirectOutputPath points to veto

Class CondGenVetoRedirectStrategy (implements VetoRedirectStrategy)

hasVeto always returns false zurück, because we dont give a veto like from other VetoStrategies described by Heiko Behrens - we only want to redirect the Ouput Path into veto Directory.

Classe ReplaceVetoRedirectedFiles (extends oAW AbstractWorkflowComponent2)

Using Apache Commons IO its very easy to compare file-content and to copy files from one directory to another.
outputFile represents a file from veto,
sourceFile represents a file from src-gen-pr

-------------------------------------------------------------------------------------
Important hint:
I was inspired to write this blog after reading the excellent article from Heiko Behrens: „Generation Gap Pattern“.

Heiko Behrens shows concrete solutions how to better handle „Generation Gap Pattern (John Vlissides)“ if using oAW (openArchitectureWare) Workflow und Xpand / XTend. This blog is not an alternate solution - only an extension !
-------------------------------------------------------------------------------------

Summary

From my point-of-view the use of „Protected Areas“ combined with „Conditional Generation“ can be very useful in some projects. Best Practises rules are not broken.

But as always: „Its Your Choice“ - it depends from project and use-cases what makes sense.

Heiko Behrens showed some strategies - if you add my ProtectedRegion strategy, I think you'll find the right for your project - or perhaps its the starting point to try it out.

Inside a big project there's no problem to use different strategies side-by-side.

Hope I gave you some new ideas.

ekke

Blog in german

oAW goes Eclipse Modeling

openArchitectureWare




During the last months oAW (openArchitectureWare) was integrated into Eclipse projects - the so-named oAW 5.0 will be in reality the first oAW Eclipse release as part from Eclipse Modeling Project inside the Galileo train:


Starting with Eclipse 3.5 M7 it would be great if many oAW user will test, if oAW 4.3.1 projects are running well using Plugins from Eclipse Modeling. (if not please report Bugzillas)

Perhaps someone will ask: why is there still an openArchitectureWare project, if all was moved to Eclipse into different projects from Eclipse Modeling ?

Eclipse Modeling contains uncount sub-projects (see also JAX session from Jan Köhnlein „Eclipse Modeling Overview“).

oAW is something like a distribution - a container of some sub-projects running well together - making it easier für users to find out out the right combination to build projects using oAW-like MDSD.

oAW is also a very active community providing much KnowHow and Support for model-driven development - look at the forums here.

There also exist some additional projects around oAW not moved to Eclipse - so try out the new Eclipse Modeling Workflow (MWE), Xpand (M2T) and Xtext (TMF) but stay tuned at openArchitectureWare.

ekke
blog in german

Thursday, April 30, 2009

OSGI Enterprise Applications: Monster Bundles from 3rdParty

The (OSGI) world could be so wonderful, all are brave OSGI citizens:

  • one JAR file == one Bundle
  • import-package used for common dependencies
  • (required-bundles if used only in the own namespace)
  • ...

If you have to develope OSGI Enterprise Business Applications, then in most cases you have to integrate 3rdParty bundles, - projects, -frameworks.

And then it can happen, that a 3rdParty project looks good on the very first view: some bundles, well structured, dependencies make sense, but..... why is this core bundle so big ?


Here you'll find the answer: „looking into 3rdParty OSGI bundles

Perhaps the Composite Bundles from upcoming OSGI R4.2 (here and here and Richard Halls Session at JAX09) can help to encapsulate such monster bundles ? I'll try and report....

ekke
blog in german