office-gobmx/vcl
Mike Kaganski 0fa827dbb2 Drop std::as_const from css::uno::Sequence iterations
Obsoleted by commit 2484de6728 (Remove
non-const Sequence::begin()/end() in internal code, 2021-10-15) and
commit fb3c04bd19 (Drop non-const
Sequence::operator[] in internal code, 2021-11-05).

Change-Id: Idbafef5d34c0d4771cbbf75b9db9712e504164cd
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/162640
Tested-by: Jenkins
Reviewed-by: Mike Kaganski <mike.kaganski@collabora.com>
2024-01-27 12:43:48 +01:00
..
android
backendtest cid#1546500 COPY_INSTEAD_OF_MOVE 2023-12-22 00:10:39 +01:00
headless move IsFuzzing to comphelper 2023-12-30 12:45:45 +01:00
inc tdf#154381 qt weld: Allow setting message box default button 2024-01-24 17:24:08 +01:00
ios
jsdialog cool#1770 sw: make Edit Sections dialog async and mark it a jsdialog 2024-01-16 07:59:51 +01:00
null
osx Drop std::as_const from css::uno::Sequence iterations 2024-01-27 12:43:48 +01:00
qa Drop std::as_const from css::uno::Sequence iterations 2024-01-27 12:43:48 +01:00
qt5 Drop std::as_const from css::uno::Sequence iterations 2024-01-27 12:43:48 +01:00
qt6 tdf#130857 Use native qt widgets - simple message dialog 2024-01-08 22:52:59 +01:00
quartz janitor: remove unnecessary conditional (macOS vs iOS) 2024-01-25 12:13:00 +01:00
skia Related tdf#158945: blacklist Intel Iris XE for Skia hardware rendering 2024-01-08 15:00:01 +01:00
source Drop std::as_const from css::uno::Sequence iterations 2024-01-27 12:43:48 +01:00
uiconfig
unx Drop std::as_const from css::uno::Sequence iterations 2024-01-27 12:43:48 +01:00
win Drop std::as_const from css::uno::Sequence iterations 2024-01-27 12:43:48 +01:00
workben Try harder to clear Use-of-uninitialized-value from LLVMFuzzerCustomMutator 2024-01-21 22:04:50 +01:00
AllLangMoTarget_vcl.mk
commonfuzzer.mk ofz#65252 Build failure 2023-12-22 11:45:43 +01:00
CppunitTest_vcl_animation.mk
CppunitTest_vcl_apitests.mk
CppunitTest_vcl_app_test.mk
CppunitTest_vcl_backend_test.mk
CppunitTest_vcl_bitmap_render_test.mk
CppunitTest_vcl_bitmap_test.mk
CppunitTest_vcl_bitmapprocessor_test.mk
CppunitTest_vcl_blocklistparser_test.mk
CppunitTest_vcl_cjk.mk
CppunitTest_vcl_dialogs_test.mk
CppunitTest_vcl_drawmode.mk
CppunitTest_vcl_errorhandler.mk
CppunitTest_vcl_filter_igif.mk
CppunitTest_vcl_filter_ipdf.mk
CppunitTest_vcl_filters_test.mk
CppunitTest_vcl_font.mk
CppunitTest_vcl_fontcharmap.mk
CppunitTest_vcl_fontfeature.mk
CppunitTest_vcl_fontmetric.mk
CppunitTest_vcl_gen.mk
CppunitTest_vcl_gradient.mk
CppunitTest_vcl_graphic_test.mk
CppunitTest_vcl_gtk3_a11y.mk
CppunitTest_vcl_jpeg_read_write_test.mk
CppunitTest_vcl_lifecycle.mk
CppunitTest_vcl_mnemonic.mk
CppunitTest_vcl_outdev.mk
CppunitTest_vcl_pdfexport.mk
CppunitTest_vcl_pdfexport2.mk
CppunitTest_vcl_pdfium_library_test.mk
CppunitTest_vcl_png_test.mk
CppunitTest_vcl_skia.mk
CppunitTest_vcl_svm_test.mk
CppunitTest_vcl_text.mk
CppunitTest_vcl_textlayout.mk vcl: test BreakLinesWithIterator with hyphens 2023-12-28 02:33:50 +01:00
CppunitTest_vcl_timer.mk
CppunitTest_vcl_type_serializer_test.mk
CppunitTest_vcl_widget_definition_reader_test.mk
CustomTarget_gtk3_kde5_moc.mk
CustomTarget_kf5_moc.mk
CustomTarget_kf6_moc.mk
CustomTarget_nativecalc.mk
CustomTarget_nativecore.mk
CustomTarget_nativedraw.mk
CustomTarget_nativemath.mk
CustomTarget_nativewriter.mk
CustomTarget_qt5_moc.mk
CustomTarget_qt6_moc.mk
Executable_602fuzzer.mk
Executable_bmpfuzzer.mk
Executable_cgmfuzzer.mk
Executable_dbffuzzer.mk
Executable_diffuzzer.mk
Executable_docxfuzzer.mk
Executable_dxffuzzer.mk
Executable_epsfuzzer.mk
Executable_fftester.mk
Executable_fodpfuzzer.mk
Executable_fodsfuzzer.mk
Executable_fodt2pdffuzzer.mk
Executable_fodtfuzzer.mk
Executable_giffuzzer.mk
Executable_htmlfuzzer.mk
Executable_hwpfuzzer.mk
Executable_icontest.mk
Executable_jpgfuzzer.mk
Executable_listfonts.mk
Executable_listglyphs.mk
Executable_lo_kde5filepicker.mk
Executable_lwpfuzzer.mk
Executable_metfuzzer.mk
Executable_minvcl.mk
Executable_mmlfuzzer.mk
Executable_mtfdemo.mk
Executable_mtpfuzzer.mk
Executable_olefuzzer.mk
Executable_pcdfuzzer.mk
Executable_pctfuzzer.mk
Executable_pcxfuzzer.mk
Executable_pngfuzzer.mk
Executable_ppmfuzzer.mk
Executable_pptfuzzer.mk
Executable_pptxfuzzer.mk
Executable_psdfuzzer.mk
Executable_qpwfuzzer.mk
Executable_rasfuzzer.mk
Executable_rtffuzzer.mk
Executable_scrtffuzzer.mk
Executable_sftfuzzer.mk
Executable_slkfuzzer.mk
Executable_svdemo.mk
Executable_svgfuzzer.mk
Executable_svmfuzzer.mk
Executable_svpclient.mk
Executable_svptest.mk
Executable_tgafuzzer.mk
Executable_tiffuzzer.mk
Executable_vcldemo.mk
Executable_visualbackendtest.mk
Executable_webpfuzzer.mk
Executable_wksfuzzer.mk
Executable_wmffuzzer.mk
Executable_ww2fuzzer.mk
Executable_ww6fuzzer.mk
Executable_ww8fuzzer.mk
Executable_xbmfuzzer.mk
Executable_xlsfuzzer.mk
Executable_xlsxfuzzer.mk
Executable_xpmfuzzer.mk
Executable_zipfuzzer.mk
IwyuFilter_vcl.yaml
Library_desktop_detector.mk
Library_vcl.mk Fix system-libfixmath 2024-01-14 19:24:20 +01:00
Library_vclplug_gen.mk
Library_vclplug_gtk3.mk
Library_vclplug_gtk3_kde5.mk
Library_vclplug_gtk4.mk gtk4 a11y: Remember LoAccessible for XAccessible 2023-12-20 17:38:08 +01:00
Library_vclplug_kf5.mk
Library_vclplug_kf6.mk
Library_vclplug_osx.mk
Library_vclplug_qt5.mk tdf#130857 Use native qt widgets - simple message dialog 2024-01-08 22:52:59 +01:00
Library_vclplug_qt6.mk tdf#130857 Use native qt widgets - simple message dialog 2024-01-08 22:52:59 +01:00
Library_vclplug_win.mk
Makefile
Module_vcl.mk vcl: add test for an invalid index in OutputDevice::GetTextBreak() 2023-12-28 02:12:38 +01:00
Package_fontunxppds.mk
Package_fontunxpsprint.mk
Package_opengl_denylist.mk
Package_osxres.mk
Package_skia_denylist.mk
Package_theme_definitions.mk
Package_tipoftheday.mk
Package_toolbarmode.mk
README.GDIMetaFile.md
README.lifecycle.md
README.md
README.scheduler.md
README.vars.md tdf#130857 Use native qt widgets - simple message dialog 2024-01-08 22:52:59 +01:00
StaticLibrary_fuzzer_calc.mk
StaticLibrary_fuzzer_core.mk
StaticLibrary_fuzzer_draw.mk
StaticLibrary_fuzzer_math.mk
StaticLibrary_fuzzer_writer.mk
StaticLibrary_vclmain.mk
UIConfig_vcl.mk
vcl.common.component
vcl.common.component.android
vcl.common.component.headless
vcl.common.component.ios
vcl.common.component.macosx
vcl.common.component.unx
vcl.common.component.windows
vclplug_win.component
WinResTarget_vcl.mk

Visual Class Library (VCL)

Visual Class Library (VCL) is responsible for the widgets (windowing, buttons, controls, file-pickers etc.), operating system abstraction, including basic rendering (e.g. the output device).

It should not be confused with Borland's Visual Component Library, which is entirely unrelated.

VCL provides a graphical toolkit similar to gtk+, Qt, SWING etc.

  • source/

    • the main cross-platform chunk of source
  • inc/

    • cross-platform abstraction headers
  • headless/

    • a backend renderer that draws to bitmaps
  • android/

    • Android backend
  • osx/

    • macOS backend
  • ios/

    • iOS backend
  • quartz/

    • code common to macOS and iOS
  • win/

    • Windows backend
  • qt5/

    • Qt5
  • qt6/

    • Qt6
  • unx/

    • X11 backend and its sub-platforms
  • How the platform abstraction works

    • InitVCL calls 'CreateSalInstance'
      • this is implemented by the compiled platform backends
    • the SalInstance vtable is the primary outward facing gateway API for platform backends
      • It is a factory for: SalFrames, SalVirtualDevices, SalPrinters, Timers, the SolarMutex, Drag&Drop and other objects, as well as the primary event loop wrapper.

Note: references to "SV" in the code mean StarView, which was a portable C++ class library for GUIs, with very old roots, that was developed by StarDivision. Nowadays it is not used by anything except LibreOffice (and OpenOffice).

"svp" stands for "StarView Plugin".

SalData implementations

Each backend must provide an implementation of the SalData class. There is no defined interface, so feel free to implement whatever suits your platform.

If your platform does font handling based on Freetype and Fontconfig, it's highly recommended to use GenericUnixSalData as the base class; there isn't really much *nix stuff in it.

Currently Windows, iOS and MacOSX have independent SalData implementations.

COM Threading

The way COM is used in LO generally:

  • vcl puts main thread into Single-threaded Apartment (STA)
  • oslWorkerWrapperFunction() puts every thread spawned via oslCreateThread() into MTA (free-threaded)

GDIMetafile

GDIMetafile is a vector drawing representation that corresponds directly to the SVM (StarView Metafile) format; it is extremely important as an intermediate format in all sorts of drawing and printing operations.

There is a class MetafileXmlDump in include/vcl/mtfxmldump.hxx that can store a GDIMetafile as XML, which makes debugging much easier since you can just use "diff" to see changes.

EMF+

emf+ is vector file format used by MSO and is successor of wmf and emf formats. see http://msdn.microsoft.com/en-us/library/cc230724.aspx for documentation. note that we didn't have this documentation from start, so part of the code predates to the time when we had guessed some parts and can be enhanced today. there also still many thing not complete

emf+ is handled a bit differently compared to original emf/wmf files, because GDIMetafile is missing features we need (mostly related to transparency, argb colors, etc.)

emf/wmf is translated to GDIMetafile in import filter vcl/source/filter/wmf and so special handling ends here

emf+ is encapsulated into GDIMetafile inside comment records and parsed/rendered later, when it reaches cppcanvas. It is parsed and rendered in cppcanvas/source/mtfrenderer. also note that there are emf+-only and emf+-dual files. dual files contains both types of records (emf and emf+) for rendering the images. these can used also in applications which don't know emf+. in that case we must ignore emf records and use emf+ for rendering. for more details see the documentation.

Parsing

wmf/emf filter --> GDI metafile with emf+ in comments --> cppcanvas metafile renderer

lately the GDIMetafile rendering path changed which also influenced emf+ rendering. now many things happen in drawing layer, where GDIMetafile is translated into drawing layer primitives. for metafiles with emf+ we let the mtfrenderer render them into bitmap (with transparency) and use this bitmap in drawinlayer. cleaner solution for current state would be to extend the drawing layer for missing features and move parsing into drawing layer (might be quite a lot of work). intermediary enhancement would be to know better the needed size/resolution of the bitmap, before we render emf+ into bitmap in drawing layer. Thorsten is working on the same problem with svg rendering, so hopefully his approach could be extended for emf+ as well. the places in drawing layer where we use canvas mtfrenderer to render into bitmaps can be found when you grep for GetUseCanvas. also look at vcl/source/gdi/gdimetafile.cxx where you can look for UseCanvas again. moving the parsing into drawinglayer might also have nice side effect for emf+-dual metafiles. in case the emf+ records are broken, it would be easier to use the duplicit emf rendering. fortunately we didn't run into such a broken emf+ file yet. but there were already few cases where we first though that the problem might be because of broken emf+ part. so far it always turned out to be another problem.

Rendering

before

vcl --> cppcanvas metafile renderer --> vcl

now

drawing layer --> vcl --> cppcanvas metafile renderer --> vcl --> drawing layer

another interesting part is actual rendering into canvas bitmap and using that bitmap later in code using vcl API.

EMF+ implementation has some extensive logging, best if you do a dbgutil build, and then

export SAL_LOG=+INFO.cppcanvas.emf+INFO.vcl.emf

before running LibreOffice; it will give you lots of useful hints.

You can also fallback to EMF (from EMF+) rendering via

export EMF_PLUS_DISABLE=1

Printing/PDF Export

Printing from Writer works like this:

  1. individual pages print by passing an appropriate OutputDevice to XRenderable
  2. in drawinglayer, a VclMetafileProcessor2D is used to record everything on the page (because the OutputDevice has been set up to record a GDIMetaFile)
  3. the pages' GDIMetaFiles are converted to PDF by the vcl::PDFWriter in vcl/source/gdi/pdfwriter*

Creating the ODF thumbnail for the first page works as above except step 3 is:

  1. the GDIMetaFile is replayed to create the thumbnail

On-screen display differs in step 1 and 2:

  1. the VCL Window gets invalidated somehow and paints itself
  2. in drawinglayer, a VclPixelProcessor2D is used to display the content

Debugging PDF export

Debugging the PDF export becomes much easier when compression is disabled (so the PDF file is directly readable) and the MARK function puts comments into the PDF file about which method generated the following PDF content.

The compression can be disabled even using an env. var:

export VCL_DEBUG_DISABLE_PDFCOMPRESSION=1

To de-compress the contents of a PDF file written by a release build or other programs, use the "pdfunzip" tool:

bin/run pdfunzip input.pdf output.pdf

SolarMutexGuard

The solar mutex is the "big kernel lock" of LibreOffice, a global one. It's a recursive mutex, so it's allowed to take the lock on the same thread multiple times, and only the last unlock will actually release the mutex.

UNO methods on components can be called from multiple threads, while the majority of the codebase is not prepared for multi-threading. One way to get around this mismatch is to create a SolarMutexGuard instance at the start of each & every UNO method implementation, but only when it is necessary:

  • Only acquire the SolarMutex if you actually need it (e.g., not in functions that return static information).

  • Only around the code that actually needs it (i.e., never call out with it locked).

This way you ensure that code (not prepared for multithreading) is still executed only on a single thread.

In case you expect that your caller takes the solar mutex, then you can use the DBG_TESTSOLARMUTEX() macro to assert that in dbgutil builds.

Event listeners are a special (but frequent) case of the "never call out with a mutex (SolarMutex or other) locked" fundamental rule:

  • UNO methods can be called from multiple threads, so most implementations take the solar mutex as their first action when necessary.

  • This can be problematic if later calling out (an event handler is called), where the called function may be an UNO method implementation as well and may be invoked on a different thread.

  • So we try to not own the solar mutex, whenever we call out (invoke event listeners).

In short, never hold any mutex unless necessary, especially not when calling out.

Read More