Invantive EstateDe volgende onderdelen beschrijven hoe je gegevens naar Exact Online kunt brengen. De gegevens worden ingelezen via de XML-import van Exact Online.
De verwerking via een achtergrondproces detecteert of de verwerking goed gegaan is en geeft een lijst van fouten weer in het logbestand, bijvoorbeeld als volgt:
2010/11/21 20:54:14 - Log Errors.0 -
2010/11/21 20:54:14 - Log Errors.0 - ------------> Linenr 1------------------------------
2010/11/21 20:54:14 - Log Errors.0 - type = 0
2010/11/21 20:54:14 - Log Errors.0 - topicCode = Accounts
2010/11/21 20:54:14 - Log Errors.0 - topicNode = Account
2010/11/21 20:54:14 - Log Errors.0 - topicDataKeyAlt = 1386
2010/11/21 20:54:14 - Log Errors.0 - date = 2010-11-21T20:51:23
2010/11/21 20:54:14 - Log Errors.0 - description = Component [Account] Een Nederlands BTW-nummer bestaat uit 14 tekens
2010/11/21 20:54:14 - Log Errors.0 - typeDescription = Error
2010/11/21 20:54:14 - Log Errors.0 -
2010/11/21 20:54:14 - Log Errors.0 - ====================
2010/11/21 20:54:14 - Log Errors.0 -
2010/11/21 20:54:14 - Log Errors.0 - ------------> Linenr 2------------------------------
2010/11/21 20:54:14 - Log Errors.0 - type = 0
2010/11/21 20:54:14 - Log Errors.0 - topicCode = Accounts
2010/11/21 20:54:14 - Log Errors.0 - topicNode = Contact
2010/11/21 20:54:14 - Log Errors.0 - topicDataKeyAlt = 5
2010/11/21 20:54:14 - Log Errors.0 - date = 2010-11-21T20:51:23
2010/11/21 20:54:14 - Log Errors.0 - description = Contact number already exists in account: 103
2010/11/21 20:54:14 - Log Errors.0 - typeDescription = Error
2010/11/21 20:54:14 - Log Errors.0 -
2010/11/21 20:54:14 - Log Errors.0 - ====================
Na het inlezen kun je de eventuele fouten ook terugvinden via het menu 'Import XML' en dan 'Log'.
Zoek hierbij op 'Fout' en 'Waarschuwing'. Via de XML-knop kun je opvragen welke gegevens niet goed verwerkt konden worden:
In het logbestand van het achtergrondproces zijn meer details te vinden over de verwerking (vet en schuin gedrukt de toelichting):
21-10-2010 18:32:24 ETL: Script output: running ETL transformation or job.
*** Het programma is gestart om 18:32 op 21 oktober.
21-10-2010 18:32:24 ETL: Configure logger.
21-10-2010 18:32:24 ETL: Configure logger to use console.
21-10-2010 18:32:24 ETL: Init steploader.
21-10-2010 18:32:24 ETL: Load natives.
21-10-2010 18:32:26 ETL: Load plugins.
21-10-2010 18:32:26 ETL: Initialize environment.
21-10-2010 18:32:26 ETL: Init job entry loader.
21-10-2010 18:32:26 ETL: Start timer.
21-10-2010 18:32:26 ETL: determination fully qualified location of the ETL file ../etl/bubs2exactonline organisations.kjb.
*** Het ETL bestand '../etl/bubs2exactonline organisations.kjb' wordt uitgevoerd.
21-10-2010 18:32:26 ETL: PL/SQL function to determine name hard coded location for ETL file is xxinvantive_get_report_loc.
21-10-2010 18:32:26 ETL: File ../etl/bubs2exactonline organisations.kjb will be loaded from /opt/prd/estate/qbubs/web/../etl/bubs2exactonline organisations.kjb using an unpacked war.
*** Na hulp van een database functie is de uiteindelijke bestandslocatie van het ETL bestand '/opt/prd/estate/qbubs/web/../etl/bubs2exactonline organisations.kjb' wordt uitgevoerd.
21-10-2010 18:32:26 ETL: File /opt/prd/estate/qbubs/web/../etl/bubs2exactonline organisations.kjb is a Kettle Job.
*** ETL scripts kunnen zowel Transformatie (*.ktr) als Job (*.kjb) zijn. Dit is een job.
21-10-2010 18:32:26 ETL: Set ETL variable BUBS_DB_SERVER to localhost.
*** De gegevens van de huidige database verbinding wordt via de omgevingsvariabelen BUBS_DB_SERVER, BUBS_DB_PORT, BUBS_DB_NAME, BUBS_DB_USER en BUBS_DB_PASSWORD doorgegeven.
21-10-2010 18:32:26 ETL: Set ETL variable BUBS_DB_PORT to 1521.
21-10-2010 18:32:26 ETL: Set ETL variable BUBS_DB_NAME to PRD11R1.
21-10-2010 18:32:26 ETL: Set ETL variable BUBS_DB_USER to qbubs_web.
21-10-2010 18:32:27 ETL: Instantiate job.
21-10-2010 18:32:27 ETL: Set internal ETL variables.
21-10-2010 18:32:27 ETL: Copy background job parameters to ETL job parameters.
21-10-2010 18:32:27 ETL: Defined variables:
BUBS_DB_NAME, BUBS_DB_PASSWORD, BUBS_DB_PORT, BUBS_DB_SERVER, BUBS_DB_USER, Internal.Cluster.Size, Internal.Job.Filename.Directory, Internal.Job.Filename.Name, Internal.Job.Name, Internal.Kettle.Build.Date, Internal.Kettle.Build.Version, Internal.Kettle.Version, Internal.Slave.Server.Name, Internal.Slave.Transformation.Number, Internal.Step.CopyNr, Internal.Step.Name, Internal.Step.Partition.ID, Internal.Step.Partition.Number, Internal.Step.Unique.Count, Internal.Step.Unique.Number, catalina.base, catalina.home, catalina.useNaming, com.sun.management.jmxremote, common.loader, file.encoding, file.encoding.pkg, file.separator, java.awt.graphicsenv, java.awt.headless, java.awt.printerjob, java.class.path, java.class.version, java.endorsed.dirs, java.ext.dirs, java.home, java.io.tmpdir, java.library.path, java.naming.factory.initial, java.naming.factory.url.pkgs, java.rmi.server.randomIDs, java.runtime.name, java.runtime.version, java.specification.name, java.specification.vendor, java.specification.version, java.util.logging.config.file, java.util.logging.manager, java.vendor, java.vendor.url, java.vendor.url.bug, java.version, java.vm.info, java.vm.name, java.vm.specification.name, java.vm.specification.vendor, java.vm.specification.version, java.vm.vendor, java.vm.version, line.separator, os.arch, os.name, os.version, package.access, package.definition, path.separator, server.loader, shared.loader, sun.arch.data.model, sun.boot.class.path, sun.boot.library.path, sun.cpu.endian, sun.cpu.isalist, sun.io.unicode.encoding, sun.java.launcher, sun.jnu.encoding, sun.management.compiler, sun.os.patch.level, tomcat.util.buf.StringCache.byte.enabled, user.country, user.dir, user.home, user.language, user.name, user.timezone
*** Dit zijn de variabelen die binnen de ETL job bekend zijn.
21-10-2010 18:32:27 ETL: Execute job.
21-10-2010 18:37:26 ETL: Wait until job finished.
21-10-2010 18:37:26 ETL: Ended processing.
21-10-2010 18:37:26 ETL: Determine number of errors.
21-10-2010 18:37:26 ETL: Determine runtime.
21-10-2010 18:37:26 ETL: 299 seconds runtime.
ETL: No errors occurred.
*** Hieronder volgt de uitvoer van de ETL job.
2010/10/21 18:32:27 - bubs2exactonline organisations.kjb - Starting entry [bubs configuration load]
2010/10/21 18:32:27 - bubs configuration load - Loading transformation from XML file [file:///opt/prd/estate/qbubs/etl/bubs configuration load.ktr]
2010/10/21 18:32:27 - bubs configuration load - Dispatching started for transformation [bubs configuration load]
2010/10/21 18:32:27 - bubs configuration load - This transformation can be replayed with replay date: 2010/10/21 18:32:27
2010/10/21 18:32:27 - Get interface profile options.0 - Finished reading query, closing connection.
2010/10/21 18:32:27 - Get interface profile options.0 - Finished processing (I=53, O=0, R=0, W=53, U=0, E=0)
2010/10/21 18:32:27 - Set Variables.0 - Setting environment variables...
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-BUBS-DIRECTORY-INPUT to value [/opt/prd/estate/qbubs/transfer/bubs/in]
*** In het begin worden profieloptiewaardes ingelezen in variabelen.
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-BUBS-DIRECTORY-INPUT-PROCESSED to value [/opt/prd/estate/qbubs/transfer/bubs/in/processed]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-BUBS-DIRECTORY-INPUT-REJECTED to value [/opt/prd/estate/qbubs/transfer/bubs/in/rejected]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-BUBS-DIRECTORY-OUTPUT to value [/opt/prd/estate/qbubs/transfer/bubs/out]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-BUBS-DIRECTORY-OUTPUT-PROCESSED to value [/opt/prd/estate/qbubs/transfer/bubs/out/processed]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-BUBS-DIRECTORY-OUTPUT-REJECTED to value [/opt/prd/estate/qbubs/transfer/bubs/out/rejected]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-RUNTIME-TRANSFORMATION-DIR-SIMPLE to value [/opt/prd/estate/qbubs/etl]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-EXACTONLINE-DIRECTORY-INPUT to value [/opt/prd/estate/qbubs/transfer/exactonline/in]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-EXACTONLINE-GEBRUIKER to value [invantive1]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-EXACTONLINE-WACHTWOORD to value [appelfl1p]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-EXACTONLINE-URL-DOWNLOAD to value [https://start.exactonline.nl/docs/XMLDownload.aspx]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-EXACTONLINE-URL-UPLOAD to value [https://start.exactonline.nl/docs/XMLUpload.aspx]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-MULTIVERS-DIRECTORY-INPUT to value []
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-INTERFACE-MULTIVERS-DIRECTORY-INPUT-PROCESSED to value []
...
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-SITE-ID to value [Invantive BV-ws35-prd11r1-QBUBS-Invantive Vision-$URL: http://subversion.invantive.com:81/repos/p104/trunk/fixes/b40_mp-005/ddl/b40_mp-005.sql $ $Rev: 6923 $]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-START-TIJD-WS to value [2010-10-21T18:32:27]
2010/10/21 18:32:27 - Set Variables.0 - Set variable BUBS-LICENTIE-NAAM-PRODUCT to value [Invantive Vision]
2010/10/21 18:32:27 - Row denormaliser.0 - Finished processing (I=0, O=0, R=53, W=1, U=0, E=0)
2010/10/21 18:32:27 - Set Variables.0 - Finished after 1 rows.
2010/10/21 18:32:27 - Set Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
2010/10/21 18:32:28 - bubs2exactonline organisations.kjb - Starting entry [Delete old Accounts files]
2010/10/21 18:32:28 - bubs2exactonline organisations.kjb - Starting entry [bubs2exactonline organisations extract]
2010/10/21 18:32:28 - bubs2exactonline organisations extract - Loading transformation from XML file [file:///opt/prd/estate/qbubs/etl/bubs2exactonline organisations extract.ktr]
2010/10/21 18:32:28 - bubs2exactonline organisations extract - Dispatching started for transformation [bubs2exactonline organisations extract]
2010/10/21 18:32:28 - bubs2exactonline organisations extract - This transformation can be replayed with replay date: 2010/10/21 18:32:28
2010/10/21 18:32:28 - XML Join.0 - Starting to run...
2010/10/21 18:32:28 - Load organisations container.0 - Finished processing (I=0, O=0, R=0, W=1, U=0, E=0)
2010/10/21 18:32:28 - xmlorganisations.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
*** Regelmatig zie je statistieken (I=input, O=output, R=gelezen, W=geschreven, E=foutmeldingen).
...
2010/10/21 18:37:26 - bubs2exactonline organisations.kjb - Starting entry [Success]
2010/10/21 18:37:26 - bubs2exactonline organisations.kjb - Finished job entry [Success] (result=[true])
2010/10/21 18:37:26 - bubs2exactonline organisations.kjb - Finished job entry [bubs2exactonline webservice put] (result=[true])
2010/10/21 18:37:26 - bubs2exactonline organisations.kjb - Finished job entry [bubs2exactonline organisations generate topic Accounts] (result=[true])
2010/10/21 18:37:26 - bubs2exactonline organisations.kjb - Finished job entry [bubs2exactonline organisations extract] (result=[true])
2010/10/21 18:37:26 - bubs2exactonline organisations.kjb - Finished job entry [Delete old Accounts files] (result=[true])
2010/10/21 18:37:26 - bubs2exactonline organisations.kjb - Finished job entry [bubs configuration load] (result=[true])
*** Einde van de uitvoer van de ETL job.
21-10-2010 18:37:26 ETL: ETL Script finished.
