Research & Publications

Research Group, Christmas 2012

Our research group works at the intersection of Computer Vision, Graphics and AI to co-create new AI algorithms and tools with the creative industries with the goal of enhancing visual content production and creativity.

Current projects focus on volumetric performance capture for AR/VR, image/video in-painting, visual asset management (e.g. visual search using natural interfaces such as sketch), and the fusion of AI and Distributed Ledger Technology for visual asset provenance and other applications.

Our research group comprises three Ph.D. students (Kary Ho, Mat Trumble, Tommy Gittings), three post-doctoral research scientists (Tu Bui, Yifan Yang, Louise Coutts), one faculty member (Andrew Gilbert) and one research engineer (Dan Cooper) and myself. We also work closely with several industry research labs including Adobe, Sony and BBC. If you are interested in a Ph.D. aligned to our research interests, informal enquiries or visits are welcome. Our work is best summarised via the papers below:

Published Papers

      2019 

  1. A. Gilbert and M. Trumble and A. Hilton and J. Collomosse. "In-painting of Wide-baseline Multiple Viewpoint Video". IEEE Transactions on Visualization and Computer Graphics (TVCG). 2019. pdf  bib
  2. A. Gilbert and M. Trumble and C. Malleson and A. Hilton and J. Collomosse. "Fusing Visual and Inertial Sensors with Semantics for 3D Human Pose Estimation". Intl. Journal of Computer Vision (IJCV). 2019. pdf  bib
  3. J. Collomosse and T. Bui and H. Jin. "LiveSketch: Query Perturbation for Guided Sketch-based Visual Search". In Proc. CVPR. 2019. pdf  bib
  4. T. Bui and D. Cooper and J. Collomosse and M. Bell and A. Green and J. Sheridan and J. Higgins and A. Das and J. Keller and O. Thereaux and A. Brown. "ARCHANGEL: Tamper-proofing Video Archives using Temporal Content Hashes on the Blockchain". In Proc. CVPR Workshops (Computer Vision, AI and Blockchain). 2019. pdf  bib

  5.   2018 

  6. Y. Yang and J. Collomosse and A. Manohar and J. Briggs and J. Steane. "TAPESTRY: Visualizing Interwoven Identities for Trust Provenance". In Proc. IEEE Symposium on Visualization for Cyber Security (VizSec). Oct 2018. pdf  bib
  7. T Bui and L Ribeiro and M Ponti and J Collomosse. "Sketching out the Details: Sketch-based Image Retrieval using Convolutional Neural Networks with Multi-stage Regression". Computers and Graphics (Elsevier). 2018. pdf  bib
  8. A. Gilbert and J. Collomosse and H. Jin and B. Price. "Disentangling Structure and Aesthetics for Content-aware Image Completion". In Proc. Computer Vision Pattern Recognition (CVPR). 2018. pdf  bib
  9. J. Collomosse and T. Bui and A. Brown and J. Sheridan and A. Green and M. Bell and J. Fawcett and J. Higgins and O. Thereaux. "ARCHANGEL: Trusted Archives of Digital Public Documents". In Proc. ACM Doc.Eng.. 2018. pdf  bib
  10. M. Trumble and A. Gilbert and A. Hilton and J. Collomosse. "Deep Autoencoder for Combined Human Pose Estimation and Body Model Upscaling". In Proc. ECCV. 2018. pdf  bib
  11. A. Gilbert and M. Volino and A. Hilton and J. Collomosse. "Volumetric performance capture from minimal camera viewpoints". In Proc. ECCV. 2018. pdf  bib
  12. M. Franceschi and D. Morelli and D. Plans and A. Brown and J. Collomosse and L. Coutts and L. Ricci. "ComeHere: Exploiting Ethereum for Secure Sharing of Healthcare Data". In Proc. European Conf. on Parallel Processing (EuroPar). 2018. pdf  bib
  13. T.Bui and L. Ribeiro and M. Ponti and J. Collomosse. "Deep Manifold Alignment for Mid-grain Sketch based Image Retrieval". In Proc. ACCV. 2018. pdf  bib
  14. Mark Bell and John Sheridan and John Collomosse and Tu Bui and Alan Brown and Jamie Fawcett and Oliver Thereaux and Jeni Tennison. "Using Blockchain to Engender Trust in Public Digital Archives". In Proc. iPRES. 2018. pdf  bib

  15.   2017 

  16. M Trumble and A Gilbert and C Malleson and A Hilton and J Collomosse. "Total Capture: 3D Human Pose Estimation Fusing Video and Inertial Sensors". Proceedings British Machine Vision Conference (BMVC). September 2017. pdf  bib
  17. M Wilber and C Fang and H Jin and A Hertzmann and J Collomosse and S Belongie. "BAM! The Behance Artistic Media Dataset for Recognition Beyond Photography". Proceedings Intl. Conf. on Computer Vision (ICCV). October 2017. pdf  bib
  18. J Collomosse and T Bui and M Wilber and C Fang and H Jin. "Sketching with Style: Visual Search with Sketches and Aesthetic Context". Proceedings Intl. Conf. on Computer Vision (ICCV). October 2017. pdf  bib
  19. T Bui and L Ribeiro and M Ponti and J Collomosse. "Compact descriptors for sketch-based image retrieval using a triplet loss convolutional neural network". Computer Vision and Image Understanding (CVIU). May 2017. pdf  bib
  20. P Rosin and D Mould and I Berger and J Collomosse and Y-K Lai and C Li and H Li and A Shamir and M Wand and T Wang and H Winnemoeller. "Benchmarking Non-Photorealistic Rendering of Portraits". Proceedings of Intl. Symp. on Non-photorealistic Animation and Rendering (NPAR). Proc. EXPRESSIVE at ACM SIGGRAPH 2017. July 2017. pdf  bib
  21. K Orzech and W Moncur and A Durrant and S James and J Collomosse. "Digital Photographic Practices as Expressions of Personhood and Identity: Variations Across School Leavers and Recent Retirees". Journal of Visual Studies. 2017. pdf  bib
  22. C. Malleson and A. Gilbert and M. Trumble and J. Collomosse and A. Hilton. "Real-time Full-Body Motion Capture from Video and IMUs". In Proc. 3DV. 2017. pdf  bib
  23. M. Ponti and L. Ribeiro and T. Nazare and T. Bui and J. Collomosse. "Everything you wanted to know about deep learning for computer vision but were afraid to ask". In Proc. SIBGRAPI-T (Tutorial). 2017. pdf  bib

  24.   2016 

  25. T Bui and L Ribeiro and M Ponti and J Collomosse. "Generalisation and Sharing in Triplet Convnets for Sketch based Visual Search". arXiv Preprint arXiv:1611.05201. November 2016. pdf  bib
  26. M Trumble and A Gilbert and A Hilton and J Collomosse. "Deep Convolutional Networks for Marker-less Human Pose Estimation from Multiple Views". Proceedings of Intl. Conf. Visual Media Production (CVMP). ACM. December 2016. pdf  bib
  27. J Collomosse and A Hilton. "Real-time Full Body Motion Control". Chapter B-4 in Handbook of Human Motion.Chapter B-4, Handbook of Human Motion. Springer. ISBN 978-3-319-14418-4.. 2016. pdf  bib
  28. S James and J Collomosse. "Evolutionary Data Purification for Social Media Classification". Proc. Intl. Conf. Pattern Recognition (ICPR). 2016. pdf  bib
  29. M Trumble and A Gilbert and A Hilton and J Collomosse. "Learning Markerless Human Pose Estimation from Multiple Viewpoint Video". Proceedings European Conf. Computer Vision (ECCV). VARVARI Workshop.. 2016. pdf  bib

  30.   2015 

  31. D Casas and C Richardt and J Collomosse and C Theobalt and A Hilton. "4D Model Flow: Precomputed Appearance Alignment for Real-time 4D Video Interpolation". Computer Graphics Forum (Proc. Pacific Graphics). 2015. pdf  bib
  32. P Huang and M Tejera and J Collomosse and A Hilton. "Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture". ACM Transactions on Graphics (ToG). Accepted, to appear.. ACM. 2015. pdf  bib
  33. J Kim and C Gray and P Asente and J Collomosse. "Comprehensible Video Thumbnails". Computer Graphics Forum (Proc. Eurographics 2015). 2015. pdf  bib
  34. T Bui and J Collomosse. "Font Finder: Visual Recognition of Typeface in Printed Documents". Proceedings of International Conference on Image Processing (ICIP). IEEE. 2015. pdf  bib
  35. C Gray and J Collomosse and J Thorpe and A Turner. "Multi-modal Video Concept Detection for Scalable Logging of Pre-Production Broadcast Content". Proceedings of Conf. on Visual Media Production (CVMP). 2015. pdf  bib
  36. T Bui and J Collomosse. "Scalable Sketch-based Image Retrieval using Color Gradient Features". Proc. ICCV 2015. 2015. pdf  bib

  37.   2014 

  38. J Collomosse and S James and A Durrant and D Trujillo-Pisanty and W Moncur and K Orzech and S Martindale and M Chantler. "Enhancing Digital Literacy by Multi-modal Data Mining of the Digital Lifespan". Proceedings of Digital Economy (DE2014). December 2014. pdf  bib
  39. T Wang and J Collomosse and A Hilton. "Wide Baseline Multi-View Video Matting using a Hybrid Markov Random Field". Proceedings of International Conference on Pattern Recognition (ICPR). IEEE. August 2014. pdf  bib
  40. D Casas and M Volino and J Collomosse and A Hilton. "4D Video Textures for Interactive Character Appearance". Computer Graphics Forum (Proc. Eurographics 2014). Eurographics. April 2014. pdf  bib
  41. T Wang and B Han and J Collomosse. "TouchCut: Fast Image and Video Segmentation using Single-Touch Interaction". Computer Vision and Image Understanding (CVIU). 2014. pdf  bib
  42. S James and M Fonseca and J Collomosse. "ReEnact: Sketch based Choreographic Design from Archival Dance Footage". Proceedings of International Conference on Multimedia Retrieval (ICMR). 2014. pdf  bib
  43. M Volino and D Casas and J Collomosse and A Hilton. "Optimal Representation of Multi-View Video". Proceedings of British Machine Vision Conference (BMVC). 2014. pdf  bib
  44. J Kim and J Collomosse. "Incremental Transfer Learning for Object Recognition in Streaming Video". Proceedings of International Conference on Image Processing (ICIP). 2014. pdf  bib
  45. D Trujillo-Pisanty and A Durrant and S Martindale and S James and J Collomosse. "Admixed Portrait: Reflections on Being Online as a New Parent". Proceedings of ACM Designing Interactive Systems (DIS). 2014. pdf  bib
  46. S James and J Collomosse. "Interactive Video Asset Retrieval using Sketched Queries". Proceedings of Conference on Visual Media Production (CVMP). 2014. pdf  bib

  47.   2013 

  48. J Kim and J Collomosse. "Semi-automated Video Logging by Incremental and Transfer Learning". Proc. Intl. Workshop on Image and Audio Analysis for Multimedia Interactive Services (WIAMIS 2013). July 2013. pdf  bib
  49. R Hu and J Collomosse. "A Performance Evaluation of the Gradient Field HOG Descriptor for Sketch Based Image Retrieval". Computer Vision and Image Understanding (CVIU). 2013. pdf  bib
  50. R Hu and J Collomosse. "Markov Random Fields for Sketch based Video Retrieval". Proceedings of International Conference on Multimedia Retrieval (ICMR). 2013. pdf  bib
  51. T Wang and J Collomosse and D Greig and A Hunter. "Learnable Stroke Models for Example-based Portrait Painting". Proc. British Machine Vision Conference (BMVC). 2013. pdf  bib
  52. C Lord and J Collomosse. "StegoNPR: Information Hiding in Painterly Renderings". Proc. Theory and Practice of Computer Graphics (TPCG) Eurographics UK. 2013. pdf  bib

  53.   2012 

  54. T Wang and J Collomosse. "Progressive Motion Diffusion of Labeling Priors for Coherent Video Segmentation". IEEE Transactions on Multimedia. 2(14) pp. 389-400 April 2012. pdf  bib
  55. C Malleson and J Collomosse. "Virtual Volumetric Graphics on Commodity Displays Using 3D Viewer Tracking". Intl. Journal of Computer Vision (IJCV). Accepted 2012. pdf  bib
  56. R Ren and J Collomosse. "Visual Sentences for Pose Retrieval over Low-resolution Cross-media Dance Collections". IEEE Transactions on Multimedia. Accepted 2012. pdf  bib
  57. J-E Kyprianidis and J Collomosse and T Wang and T Isenberg. "State of the \'Art\': A Taxonomy of Artistic Stylization Techniques for Images and Video". IEEE Transactions on Visualization and Computer Graphics. 2012. pdf  bib
  58. R Hu and S James and J Collomosse. "Annotated Free-hand Sketches for Video Retrieval using Object Semantics and Motion". Proc. ACM MultiMedia Modelling (MMM). Springer LNCS. 2012. pdf  bib
  59. T Wang and B Han and J Collomosse. "Touchcut: Single-touch object segmentation driven by level set methods". Proceedings of International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2012. pdf  bib

  60.   2011 

  61. E Syngelakis and J Collomosse. "A Bag of Features Approach to Ambient Fall Detection for Domestic Elder-care". Proc. Intl. Symp. on Ambient Technologies (AMBIENT 2011). October 2011. pdf  bib
  62. T. Wang and J. Collomosse and R. Hu and D. Slatter and P. Cheatle and D. Greig. "Stylized Ambient Displays of Digital Media Collections". Computers and Graphics. 35(1) pp. 54-66 March 2011. pdf  bib
  63. R. Ren and J. Collomosse and J. Jose. "A BOVW Based Query Generative Model". Proc. ACM MultiMedia Modelling (MMM). January 2011. pdf  bib
  64. R Hu and T Wang and J Collomosse. "A Bag of Regions based approach to Sketch based Image Retrieval". Proc. Intl. Conf. Image Processing (ICIP). 2011. pdf  bib
  65. C Malleson and J Collomosse. "Volumetric 3D Graphics on Commodity Displays using Active Gaze Tracking". Proc. ICCV Workshops. 2011. pdf  bib

  66.   2010 

  67. R Hu and M Barnard and J Collomosse. "Gradient Field Descriptor for Sketch based Retrieval and Localization". In Proceedings of Intl. Conf. on Image Proc. (ICIP). IEEE. September 2010. pdf  bib
  68. T Wang and J Guillemaut and J Collomosse. "Multi-label Propagation for Coherent Video Segmentation and Artistic Stylization". In Proceedings of Intl. Conf. on Image Proc. (ICIP). IEEE. September 2010. pdf  bib
  69. E Oneill and J Collomosse and T Jay and K Yousef and M Reiser and S Jones. "Older User Experience: An Evaluation with a Location-based Mobile Multimedia Service". IEEE Vehicular Technology Magazine. IEEE. 1(5) pp. 31-38 March 2010. pdf  bib
  70. T Wang and J Collomosse and D Slatter and P Cheatle and D Greig. "Video Stylization for Digital Ambient Displays of Home Movies". In In Proceedings ACM 4th Intl. Symposium on Non-photorealistic Animation and Rendering (NPAR). ACM Press. June 2010. pdf  bib
  71. R Hu and J Collomosse. "Motion-sketch based Video Retrieval using a Trellis Levenshtein Distance". In Intl. Conf. on Pattern Recognition (ICPR). August 2010. pdf  bib

  72.   2009 

  73. J Collomosse and G. McNeill and Y. Qian. "Storyboard sketches for content based video retrieval". In Proceedings of Intl. Conf. Computer Vision (ICCV). IEEE. September 2009. pdf  bib
  74. T Wang and A Mansfield and R Hu and J Collomosse. "An Evolutionary Approach to Automatic Video Editing". Proc. 6th European Conf. on Visual Media Production (CVMP). November 2009. pdf  bib
  75. M Brosnan and I Walker and J Collomosse. "The effect of explicitly varying the proportion of same and different responses on sex difference in the Shepard and Metzler mental rotation task". Journal of Cognitive Psychology. pp. 172-189 May 2009. pdf  bib
  76. P Keitler and F Pankratz and B Schwerdtfeger and D Pustka and W Rodiger and G Klinker and C Rauch and A Chathoth and J Collomosse and Y Song. "Mobile Augmented Reality based 3D Snapshots". In Proc. GI-Workshop on VR/AR. 2009. pdf  bib

  77.   2008 

  78. Y Z Song and P M Hall and P L Rosin and J P Collomosse. "Arty Shapes". In Proceedings of Computational Aesthetics. pp. 65-73 June 2008. pdf  bib
  79. J Collomosse and T Kindberg. "Screen Codes: Visual Hyperlinks for Displays". In Proceedings HOTmobile. February 2008. pdf  bib
  80. J P Collomosse and G McNeill and L Watts. "Free-hand sketch grouping for video retrieval". In Intl. Conf on Pattern Recognition (ICPR). 2008. pdf  bib

  81.   2007 

  82. J Collomosse. "Evolutionary search for the artistic rendering of photographs". The Art of Artificial Evolution: A Handbook. Springer-Verlag. Ch. 2 pp. 39-62 November 2007. pdf  bib
  83. P M Hall and J P Collomosse and P Shen and Y Z Song. "RTcams: A New Perspective on Non-Photorealistic Rendering from Photographs". IEEE Transactions on Visualization and Computer Graphics (TVCG). 2007. pdf  bib
  84. J Collomosse and T Kindberg. "Screen Codes: Efficient Data Transfer from Video Displays to Mobile Devices". In Proceedings of 3rd European Conf. on Visual Media Production (CVMP). 2007. pdf  bib
  85. G McNeill and J Collomosse. "Reverse Storyboarding for Video Retrieval". In Proceedings of 3rd European Conf. on Visual Media Production (CVMP). 2007. pdf  bib

  86.   2006 

  87. J P Collomosse and P M Hall. "Video motion analysis for the synthesis of dynamic cues and Futurist art". Graphical Models. Elsevier. 68(5) September 2006. pdf  bib
  88. M Shugrina and M Betke and J Collomosse. "Empathic Painting: Interactive stylization using observed emotional state". In Proceedings ACM 4th Intl. Symposium on Non-photorealistic Animation and Rendering (NPAR). ACM Press. pp. 87-96 June 2006. pdf  bib
  89. J Collomosse and P Hall. "Salience-adaptive Painterly Rendering using Genetic Search". Intl. Journal on Artificial Intelligence Tools (IJAIT). 15(4) pp. 551-576 August 2006. pdf  bib
  90. J Collomosse. "Supervised genetic search for parameter selection in painterly rendering". In Proceedings EvoMUSART (LNCS). Springer. vol. 3907 pp. 599-610 April 2006. pdf  bib
  91. J P Collomosse and K Al Mosawi and E O\'Neill. "Viewpoint Invariant Image Retrieval for Context in Urban Environments". In Proceedings of 2nd European Conf. on Visual Media Production (CVMP). 2006. pdf  bib
  92. J Collomosse. "Real-time Environment Mapping for Stylised Augmented Reality". In Proceedings of 2nd European Conf. on Visual Media Production (CVMP). 2006. pdf  bib

  93.   2005 

  94. J P Collomosse and D Rowntree and P M Hall. "Stroke Surfaces: Temporally Coherent Non-photorealistic Animations from Video". IEEE Transactions on Visualization and Computer Graphics (TVCG). IEEE. 5(11) pp. 540-549 September 2005. pdf  bib
  95. J P Collomosse and D Rowntree and P M Hall. "Rendering cartoon style motion cues in post-production video". Graphical Models. Elsevier. 6(67) pp. 549-564 November 2005. pdf  bib
  96. J Collomosse and P Hall. "Genetic Paint: A Search for Salient Paintings". In Proceedings of EvoMUSART (LNCS). Springer. vol. 3449 pp. 437-447 March 2005. pdf  bib
  97. J Collomosse and P Hall. "Motion analysis in video: dolls, dynamic cues and Modern Art". In Proceedings of Free-hand sketch grouping for video retrieval. Eurographics. pp. 109-116 July 2005. pdf  bib
  98. J P Collomosse and D Rowntree and P M Hall. "Video Paintbox: The Fine Art of Video Painting". Computers & Graphics. Elsevier. 29(6) pp. 862-870 December 2005. pdf  bib

  99.   2004 

  100. J Collomosse and P Hall. "A Mid-level Description of Video, with Application to Non-photorealistic Animation". In Proceedings 15th British Machine Vision Conference (BMVC). vol. 1 pp. 7-16 September 2004. pdf  bib
  101. J Collomosse. "Higher Level Techniques for the Artistic Rendering of Images and Video". PhD thesis. Dept. Computer Science, University of Bath . May 2004. pdf  bib
  102. P M Hall and M J Owen and J P Collomosse. "A Trainable Low-level Feature Detector". In Proceedings Intl. Conference on Pattern Recognition (ICPR). IEEE. vol. 1 pp. 708-711 August 2004. pdf  bib

  103.   2003 

  104. J P Collomosse and D Rowntree and P M Hall. "Video analysis for Cartoon-style Special Effects". In Proceedings 14th British Machine Vision Conference (BMVC). vol. 2 pp. 749-758 September 2003. pdf  bib
  105. J Collomosse and P Hall. "Cubist Style Rendering from Photographs". IEEE Transactions on Visualization and Computer Graphics (TVCG). IEEE. 9(4) pp. 443-453 October 2003. pdf  bib
  106. J P Collomosse and D Rowntree and P M Hall. "Cartoon-style Rendering of Motion from Video". In Proceedings Video, Vision and Graphics (VVG). Eurographics. pp. 117-124 July 2003. pdf  bib

  107.   2002 

  108. J P Collomosse and P M Hall. "Painterly Rendering using Image Salience". In Proceedings 20th Eurographics UK Conference (EGUK). Eurographics. pp. 122-128 June 2002. pdf  bib


Patents Awarded (with HP Labs)

  1. Screen Codes for Data Transfer between Dispalys and Mobile Devices, J. P. Collomosse and T. Kindberg. 2007.
  2. A Spatio-temporal Coding Scheme for Robust Data Transfer in Screen Codes, J. P. Collomosse and T. Kindberg. 2007.
  3. Method for Detecting Noise and Synchronization Conditions when Imaging a Screen Code on a Video Display, J. P. Collomosse and T. Kindberg. 2007.

  4. PhD Thesis (University of Bath, 2004)

    1. Higher Level Techniques for the Artistic Rendering of Images and Video    J. P. Collomosse. 2004.