Building iDempiere by tycho

From iDempiere en
Revision as of 03:58, 27 November 2018 by Hieplq (talk | contribs) (backup link for "Tycho Build Tools")

Why move to Maven Tycho?

  1. Buckminster is no longer maintained
  2. Maven has huge following

More discussion at IDEMPIERE-3531 and group

Prepare Eclipse to handle Tycho Project

Install Tycho Support

  1. Go to Eclipse Marketplace
  2. Search for Tycho
  3. Choose to install "Tycho Build Tools" and "Maven Tycho Utilities"

note:while server of "Tycho Build Tools" is down, you can install it from link

https://raw.githubusercontent.com/idempiere/binary.file/master/p2-third-party/tycho-build-tools

Install m2e Connector

  1. Go to Window/Preferences
  2. Menu Maven/Discovery
  3. Click Open Catalog
  4. On Find field, enter Tycho
  5. Select Tycho Configurator, click Finish to install it
  6. Restart Eclipse and use the same dialog to install m2e connector for maven-dependency-plugin

Note: Use Help > About Eclipse IDE > Installation Details > Installed Software to find out the list of m2e Connector and Tycho plugins that you have installed.

Steps to build and setup development environment

  1. Materialize and build (this step is needed for both headless build and setup of Eclipse)
    1. Clone source from bitbucket.org to a folder [idempiere-home]
    2. Open terminal, cd to [idempiere-home] and execute command "mvn verify" (in case you focus to setup eclipse, don't want to build product, use "mvn validate")
      • Downloads all libraries on Bundle-ClassPath
      • Build all projects and output binary to [idempiere-home]/org.idempiere.p2/target/products
  2. Setup Eclipse Workspace
    1. Import Projects
      1. Open Eclipse with Workspace at [idempiere-home]
      2. From Eclipse Menu, choose File/Import
      3. At Import dialog, choose Maven/Existing Maven Projects
      4. Click Next button and Browse to [idempiere-home]
      5. Select all projects, click Finish to complete the import
      6. All projects are loaded to workspace
    2. Set Target Platform
      1. From Eclipse Menu, choose File/Import
      2. At Import dialog, choose General/Existing Projects into Workspace
      3. Click Next button and Browse to [idempiere-home]/org.idempiere.p2.targetplatform. Click Finish to complete the import
      4. Open the org.idempiere.p2.targetplatform/org.idempiere.p2.targetplatform.target file. This is the default target platform definition with remote url
      5. At Target Editor, click the "Set as Active Target Platform" link
      6. Wait for Eclipse to download bundles onto target platform. Click the "Reload Target Platform" link if some download fail
    3. Say good bye to Buckminster
  3. Know issue
    1. in case you do step "Import Projects" before "mvn validate" eclipse will auto change some classpath, so you you will build fail ever you run "mvn validate". Need to revert change of eclipse before you run "mvn validate"

Hengsin (talk) 05:54, 20 October 2018 (UTC), org.idempiere.p2.targetplatform/org.idempiere.p2.targetplatform.target is slow and error prone for me. I'm not sure that's the intended alternative but idempiere/org.idempiere.p2/target/repository works fine for me as Target Platform (add new empty target platform and add the idempiere/org.idempiere.p2/target/repository folder/directory to it) and without all the hassle with org.idempiere.p2.targetplatform/org.idempiere.p2.targetplatform.target

Config For Jenkins

  1. Setup Maven for Jenkins
  2. Create a Maven Project
  3. In "Source Code Management" Section
  4. On build step, setup with value:
    • Root POM=pom.xml
    • Goals and options=verify

How to set an OSGi Plugin as a Maven Project

  1. Create a normal plugin/feature project on eclipse
  2. Right click on project and choose "Configure/Convert to Maven Project"
  3. At dialog, value of "Package" type field depends on type of plug-in
    • Eclipse feature => "eclipse-feature"
    • Eclipse plugin/fragment => "eclipse-plugin"
  4. After eclipse has converted project, there will be a pom.xml inside project space, please adjust value as below:
    • Add parent section
    <parent>
        <groupId>org.idempiere</groupId>
	<artifactId>org.idempiere.parent</artifactId>
	<version>5.1.0-SNAPSHOT</version>
	<relativePath>../org.idempiere.parent/pom.xml</relativePath>
    </parent>
  1. Open MANIFEST.MF and continue checking..
    • At Runtime tab, section classpath has item "." if not, you should create one
  2. In build.properties
    • Adjust Output to "/target/classes"
    • In case your project has source, make sure it is stated: "source.. = src/"
  3. Reference:

Build Extra Plugin

Build by Run Script from local

  1. Build idempiere core so we have a p2 repository that contains idempiere core plus dependency at idempiere/org.idempiere.p2/target/repository
  2. Host this repository with a web server. If you don't have one, you can use jetty-maven-plugin to host it
  3. Create a maven tycho target plugin point to the p2 repository server setup at step 2
  4. Build extra plugin by using target at step 3

Full example and step by step guideline here

Build by Run Jenkins Job

Because you have to check out from multi repository, I prefer to use jenkins pipeline

Besides, normal pipeline plugin, you have to install "Pipeline Maven Integration Plugin"

For newbie to jenkins pipeline, I suggest to use this tool to generate script http://%5Bjenkins_server%5D/job/%5Bjob_name%5D/pipeline-syntax/

Pipeline syntax.png

Steps to build

  1. Setup a web server (like apache httpd at port 80 on same server jenkin, for access by localhost), assume document dir at /var/www/html
  2. Setup a jenkins job to build idempiere core.
  3. Successful build will copy artifact to /var/www/html/idempiere-core/latest
  4. This is pipeline for build idempiere-core
node {
   def mvnHome
   stage('Preparation') { // for display purposes
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', revision: 'hsv', source: 'ssh://hg@bitbucket.org/hasuvimex/idempiere', subdir: 'idempiere'])
   }
   stage('Build') {
            
        withMaven(jdk: 'openjdk', maven: 'build-in maven', publisherStrategy: 'EXPLICIT') {
            sh "cd ${WORKSPACE}/idempiere && mvn verify"
        }
        
        sh '''p2OutputDir="${WORKSPACE}/idempiere/org.idempiere.p2/target/repository"
            webDir="/var/www/html/repository/idempiere-hsv-core/latest"
            mkdir -p ${webDir}
            cp -r ${p2OutputDir}/* ${webDir}'''
   }
   stage('Results') {
 
   }
}
  1. Setup other jenkins job to build extra plugin
  2. This's pipeline script
node {
   def mvnHome
   stage('Preparation') { // for display purposes
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', revision: 'hsv', source: 'ssh://hg@bitbucket.org/hasuvimex/idempiere', subdir: 'idempiere'])
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', revision: 'hsv', source: 'ssh://hg@bitbucket.org/idplugin/idempiere.maven.tycho.build.extra.bundle', subdir: 'idempiere.maven.tycho.build.extra.bundle'])
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', source: 'ssh://hg@bitbucket.org/hasuvimex/project.extra.bundle', subdir: 'project.extra.bundle'])
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', revision: 'hsv', source: 'ssh://hg@bitbucket.org/hasuvimex/org.idempiere.customize-feature', subdir: 'project.extra.bundle/org.idempiere.customize-feature'])
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', source: 'ssh://hg@bitbucket.org/idplugin/th.motive.idempiere.base', subdir: 'project.extra.bundle/th.motive.idempiere.base'])
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', source: 'ssh://hg@bitbucket.org/idplugin/th.motive.jasper.report.font', subdir: 'project.extra.bundle/th.motive.jasper.report.font'])
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', source: 'ssh://hg@bitbucket.org/idplugin/th.motive.utility', subdir: 'project.extra.bundle/th.motive.utility'])
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', source: 'ssh://hg@bitbucket.org/hasuvimex/vn.hsv.editor.currencyrate', subdir: 'project.extra.bundle/vn.hsv.editor.currencyRate'])
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', source: 'ssh://hg@bitbucket.org/hasuvimex/vn.hsv.idempiere.base', subdir: 'project.extra.bundle/vn.hsv.idempiere.base'])
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', source: 'ssh://hg@bitbucket.org/hasuvimex/vn.hsv.idempiere.override', subdir: 'project.extra.bundle/vn.hsv.idempiere.override'])
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', source: 'ssh://hg@bitbucket.org/hasuvimex/vn.hsv.jasperreport.install', subdir: 'project.extra.bundle/vn.hsv.jasperreport.install'])
        checkout([$class: 'MercurialSCM', clean: true, credentialsId: 'mainSshKey', source: 'ssh://hg@bitbucket.org/idplugin/th.motive.jasperreport.configuration', subdir: 'project.extra.bundle/th.motive.jasperreport.configuration'])
        
   }
   stage('Build') {
            
        withMaven(jdk: 'openjdk', maven: 'build-in maven', publisherStrategy: 'EXPLICIT') {
            sh  '''
                    ${WORKSPACE}/idempiere.maven.tycho.build.extra.bundle/update.version.sh "/var/www/html/repository/idempiere-hsv-core/latest/plugins" "org.adempiere.base_*.jar"
                '''
        }
        
        
        sh '''newP2Url="http://localhost/repository/idempiere-hsv-core/latest"
            oldP2Url=http://localhost:8080/idempiere-core
            sed -ri "s|${oldP2Url}|${newP2Url}|g" ${WORKSPACE}/idempiere.maven.tycho.build.extra.bundle/org.idempiere.p2.build.extra.bundle.targetplatform/org.idempiere.p2.build.extra.bundle.targetplatform.target'''
        
        withMaven(jdk: 'openjdk', maven: 'build-in maven', publisherStrategy: 'EXPLICIT') {
            sh '''cd ${WORKSPACE}/idempiere.maven.tycho.build.extra.bundle && mvn verify -Didempiere.target="org.idempiere.p2.build.extra.bundle.targetplatform"'''
        }
   }
   stage('Results') {
 
   }
}

note: you still have to checkout idempire on this job, because some plugin refer to parent pom on idempiere

Common command

  • mvn verify -P online
    • build idempiere with online profile (will use remote repository to feed all dependency bundle)

Summary about tycho use on idempiere (for full reference tycho API)

[idempiere-root]/pom.xml

setup list of module (bundle) that build with command "mvn verify -P online"

[idempiere-root]/org.idempiere.parent/pom.xml

  • parent pom with common configuration, for other bundle to inherit from this pom
  • profiles
    • Set properties for build condition, currently use to setup online and offline repository
  • repositories
    • Setup list of repository to resolve dependency
    • with P2 repository use "<layout>p2</layout>"
  • dependencies
    • define OSGi bundles feed from maven repositories

Known Issue

  1. Before the completion of step 2.2 (Set Target Platform), you should turn off "Project/Build Automatically". Before the setting of Active Target Platform, build will be slow and full with errors.
  2. Sometimes due to condition in Sourceforge, the setting of Active Target Platform ends with errors, hindering a complete clean build. Take a look bellow for tips:
TargetIssue.png

Reference

API to configure tycho

More API to configure tycho plugin

Sync bundle version on manifest with version on pom.xml

Tycho package type

A good summary

Idempiere maven tycho is MANIFEST-First

A complete guide about tycho setup (Must read)

Explain about root-ui for feature

See Also

Update_JDK

Retrieved from "https://wiki.idempiere.org/w-en/index.php?title=Building_iDempiere_by_tycho&oldid=14433"
Cookies help us deliver our services. By using our services, you agree to our use of cookies.
GNU-Lizenz für freie Dokumentation 1.3 oder höher
Powered by MediaWiki