Downloaded 55 times
Alfresco Transform Service DevCon 2019
- 1. Transforming Transformers for ACS6.1 and beyond ! Jan Vonka Architect & Product Owner @ Alfresco
- 2.
- 3. Learn. Connect. Collaborate. Agenda •Introduction • Themes • Why … ? • Evolutionary Architecture • Alfresco Transform Service • Deployment Options • Scalable Load Testing (Demo) • Future Ideas … ? • Recap & Links • Q & A
- 4. Learn. Connect. Collaborate. •Jan Vonka – https://slideshare.net/jvonka • Architect & Product Owner • Hot-air balloonist https://www.deviantart.com/eddiekisosondi/art/HOT-AIR- JELLYFISH-315503032
- 5. Learn. Connect. Collaborate. •Information & features presented will change • Features are Enterprise • We look forward to collaborating with you … • … to improve & extend the Transform Service Disclaimer
- 6.
- 7. Learn. Connect. Collaborate. Evolution Themes ChangeTransformation Future
- 8. Learn. Connect. Collaborate. Evolution– March of Progress http://mentalfloss.com/article/27542/10-variations-our-march-progress ➡ Evolutionary Architecture ➡ Monolith to Microservices ➡ Frequent Incremental Releases ➡ Containerised Deployments ➡ Independently-Scalable ➡ Simple & Safe Upgrades
- 9. Learn. Connect. Collaborate. Evolution- SkyNet https://www.deviantart.com/weylandyutanicorp/art/Skynet-Terminator-Models-419812236
- 10. Learn. Connect. Collaborate. Change TransmutationChange in Substance Transformation Change in Shape Metamorphosis Change in Form
- 11. Learn. Connect. Collaborate. Transformingthe Transformers … https://michaelbaystransformers.fandom.com
- 12. Learn. Connect. Collaborate. ...Meta Metamorphosis ! -
- 13.
- 14. Learn. Connect. Collaborate. Before… • Alfresco Content Services (ACS) Repository • Local & embedded transformers • New content generates renditions (eg. thumbnails & previews) • Consumes resources (Repository JVM or underlying O/S) • Limited Scalability Options • May be a limiting factor when ingesting lots of content • Only option to scale transforms => scale the Repository • Potential security concern when run on same “machine” as Repository
- 15.
- 16. Learn. Connect. Collaborate. Now… • Evolve ACS Repository Architecture • incrementally break-up the monolith • asynchronously off-load transforms • support large-scale ingestion & migration to ACS • Introduce new Alfresco Transform Service (ATS) • loosely-coupled & event-driven • independently scalable & upgradable • option to use across Digital Business Platform (DBP)
- 17.
- 18.
- 19. Learn. Connect. Collaborate. Local/ Embedded Transformers (ACS <= 5.2) Content Services Process Services Content + Governance Apps Process Apps Files Meta data Search Files Meta data SearchIdentity Identity ProcessTransforms Transforms Governance
- 20. Learn. Connect. Collaborate. •Spring Boot 1.x • Docker • REST API Evolve: ACS 6.0 ACS imagemagiimagemagiimagemagick imagemagick imagemagicklibreoffice imagemagick imagemagickpdf-renderer Synchronous POST (multipart/form-data)
- 21. Learn. Connect. Collaborate. NewTransform Service (ACS >= 6.1) Files Meta data Search Content + Process Apps ADF Identity Common Transform Service Content Services Content + Governance Apps ProcessTransforms Governance
- 22. Learn. Connect. Collaborate. JohnNewton @ DevCon 2019
- 23.
- 24. Learn. Connect. Collaborate. TransformService 1.0 https://github.com/Alfresco/acs-deployment/releases Transform Service imagemagic k imagemagic k imagemagic k imagemagic k ACS 6.1 imagemagic k imagemagic k imagemagic k imagemagic k tika pdf-renderer libreoffice imagemagick imagemagick imagemagick imagemagic k imagemagic k Shared File Store T-Engines ActiveMQ • Spring Boot 2.x • Micrometer (eg. Prometheus) • Messaging (ActiveMQ) • Docker / Kubernetes T-Router 1 2 3 4 5 6 7
- 25. Learn. Connect. Collaborate. Design– Sequence Diagram
- 26. Learn. Connect. Collaborate. ACS6.1 Async Rendition Service V1 REST APIV0 REST API Rendition Service 2 Rendition Service Thumbnail Service Action Service Content Service Shared File Store <<Docker>> Content Update Transform Service T-Router <<Docker>> Transformers <<Docker>> Transformers <<Docker>> Transformers <<Docker>> T-Engines <<Docker>> Transform Response Transform Request TransformerTransformerLocal Transformers Solr 6 101010 101010 101010
- 27. Learn. Connect. Collaborate. renditiongif jpeg png docx xlsx pptx msg doc xls ppt doclib png imgpreview jpeg pdf pdf medium jpeg avatar png avatar32 png webpreview swf ACS 6.1 Renditions supported by Transform Service 1.0 (*) ACS 6.1 uses 36 transforms out of the 60 provided by the Transform Service 1.0
- 28.
- 29. Learn. Connect. Collaborate. Deployment- Docker Compose (for Dev / Trial) https://github.com/Alfresco/acs-deployment/releases
- 30. Learn. Connect. Collaborate. CloudNative vs Cloud Agnostic … https://landscape.cncf.io Cloud Native Computing Foundation (CNCF)
- 31. Learn. Connect. Collaborate. Deployment- Helm / Kubernetes (Reference) https://github.com/Alfresco/acs-deployment/releases
- 32. Learn. Connect. Collaborate. ContainerOrchestration => Kubernetes (k8s) GKE AKSEKS
- 33. Learn. Connect. Collaborate. Deployment– AWS Managed Services (Reference) https://github.com/Alfresco/acs-deployment-aws/releases Transform Service imagemagic k imagemagic k imagemagic k imagemagic k ACS imagemagic k imagemagic k imagemagic k imagemagic k tika pdf-renderer libreoffice imagemagick imagemagick imagemagick T-Router Amazon EFS imagemagic k imagemagic k Shared File Store T-Engines Amazon RDS Amazon S3
- 34. Learn. Connect. Collaborate. Documentation https://docs.alfresco.com/transform/concepts/transformservice-overview.html* (* published with ACS 6.1 release)
- 35.
- 36. Learn. Connect. Collaborate. UsingGatling for Load Testing Client: - What’s the performance of your application ? - Is it scalable? - How much it costs to run your product ? Dev: - This change can’t impact performance … QA: - … it did ;-) https://gatling.io/
- 37.
- 38. Learn. Connect. Collaborate. UsingGatling for ATS Load Testing
- 39.
- 40. Learn. Connect. Collaborate. FutureIdeas ? Disclaimer: Subject to change … we look forward to collaborating with you • Proposed Next – More Scaling – T-Engines Queues (async) – Event Gateway – Heartbeat • And Beyond – Extensibility Options (custom transformers) – New T-Clients & T-Engines (more transformers) – Dynamic Auto-Scaling
- 41. Learn. Connect. Collaborate. TransformService 1.0.x https://github.com/Alfresco/acs-deployment-aws/releases Transform Service imagemagic k imagemagic k imagemagic k imagemagic k ACS imagemagic k imagemagic k imagemagic k imagemagic k tika pdf-renderer libreoffice imagemagick imagemagick imagemagick T-Router Amazon EFS imagemagic k imagemagic k Shared File Store T-Engines Amazon RDS Amazon S3 Planned
- 42. Learn. Connect. Collaborate. imagemagick imagemagick T-Router imagem agick imagem agick DBPTransform Service (on K8S / AWS) Amazon S3 Amazon EFS DBP Transform Service imagema gick imagema gick imagem agick imagem agick AWS * Amazon RDS ASE ACS DBP Event Gateway (No@fica@ons) imagema gick imagema gick imagem agick imagem agick custom Amazon Elastic Transcoder Heartbeat Server Aggregated Usage APS imagem agick imagem agick T-Engines Future Ideas ?
- 43.
- 44. Learn. Connect. Collaborate. RecapEvolutionary Architecture • Alfresco architecture will continue to evolve – Agility – Stability – Scalability • Transform Service 1.0 works with ACS 6.1 – Reference Deployments (Helm/K8s + AWS stack) – Download Trial (docker compose)
- 45. Learn. Connect. Collaborate. @DevCon 2019 • Architectural Changes in Repo 6.1+ – Stefan Kopf & Alex Mukha (Thursday @ 10:45) • Porting Custom Transforms to new ATS – Alan Davis (Thursday @ 13:30) • The Transform Graph – Lucian Tuca (Wednesday @ 11:00)
- 46. Learn. Connect. Collaborate. Transform ServiceReleases (part of ACS Deployment) • https://github.com/Alfresco/acs-deployment • https://github.com/Alfresco/acs-deployment-aws Documentation • https://docs.alfresco.com/transform/concepts/trans form-overview.html * (* published with ACS 6.1 release)
- 47. Thank You https://slideshare.net/jvonka Transforming Transformers forACS 6.1 and beyond ! https://www.youtube.com/embed/oa1XVYZOfLU