office-gobmx/vcl
Michael Stahl d45bd161a4 vcl: don't override user's SSL_CERT_FILE for bundled OpenSSL
Change-Id: I5d61fe62c2e6814ea757a0b543f7dbf45e0db456
Reviewed-on: https://gerrit.libreoffice.org/c/core/+/159219
Tested-by: Jenkins
Reviewed-by: Michael Stahl <michael.stahl@allotropia.de>
2023-11-10 10:15:51 +01:00
..
android
backendtest
headless vcl: no raw pointers 2023-10-29 12:21:34 +01:00
inc loplugin:fieldcast in AnimationData 2023-11-08 06:50:46 +01:00
ios Fix iOS build breakages when building on macOS Sonoma 2023-10-01 15:55:55 +02:00
jsdialog sw floattable: make Insert Frame dialog async and mark it as a jsdialog 2023-11-06 18:29:06 +01:00
null
osx tdf#155266 force flush after scrolling 2023-11-06 20:27:08 +01:00
qa loplugin:unreffun (clang-cl) 2023-11-08 22:50:26 +01:00
qt5 qt a11y: Map AccessibleStateType::INDETERMINATE to Qt equivalent 2023-11-07 07:58:28 +01:00
qt6
quartz Various -Werror,-Wvla-cxx-extension 2023-10-27 22:12:07 +02:00
skia tdf#158014 make image immutable after using Skia to invert 2023-11-03 18:33:23 +01:00
source vcl: don't override user's SSL_CERT_FILE for bundled OpenSSL 2023-11-10 10:15:51 +01:00
uiconfig
unx gtk4 a11y: Handle the "level" object attribute 2023-11-09 21:00:05 +01:00
win loplugin:stringstatic, lopluign:ostr (clang-cl) 2023-11-08 18:58:40 +01:00
workben bump odt2pdffuzzer max_len again 2023-10-09 22:31:05 +02:00
AllLangMoTarget_vcl.mk
commonfuzzer.mk ofz#63962 build failure 2023-11-08 09:45:02 +01:00
CppunitTest_vcl_animation.mk
CppunitTest_vcl_apitests.mk
CppunitTest_vcl_app_test.mk
CppunitTest_vcl_backend_test.mk
CppunitTest_vcl_bitmap_render_test.mk
CppunitTest_vcl_bitmap_test.mk
CppunitTest_vcl_bitmapprocessor_test.mk
CppunitTest_vcl_blocklistparser_test.mk
CppunitTest_vcl_cjk.mk
CppunitTest_vcl_dialogs_test.mk
CppunitTest_vcl_drawmode.mk
CppunitTest_vcl_errorhandler.mk
CppunitTest_vcl_filter_igif.mk
CppunitTest_vcl_filter_ipdf.mk
CppunitTest_vcl_filters_test.mk
CppunitTest_vcl_font.mk
CppunitTest_vcl_fontcharmap.mk
CppunitTest_vcl_fontfeature.mk
CppunitTest_vcl_fontmetric.mk
CppunitTest_vcl_gen.mk
CppunitTest_vcl_gradient.mk
CppunitTest_vcl_graphic_test.mk
CppunitTest_vcl_gtk3_a11y.mk gtk3 a11y test: Let xvfb-run auto-determine free server num 2023-10-17 07:50:37 +02:00
CppunitTest_vcl_jpeg_read_write_test.mk
CppunitTest_vcl_lifecycle.mk
CppunitTest_vcl_mnemonic.mk
CppunitTest_vcl_outdev.mk
CppunitTest_vcl_pdfexport.mk
CppunitTest_vcl_pdfexport2.mk CppunitTest_vcl_pdfexport: split into two 2023-10-31 08:42:56 +01:00
CppunitTest_vcl_pdfium_library_test.mk
CppunitTest_vcl_png_test.mk
CppunitTest_vcl_skia.mk
CppunitTest_vcl_svm_test.mk
CppunitTest_vcl_text.mk
CppunitTest_vcl_timer.mk
CppunitTest_vcl_type_serializer_test.mk
CppunitTest_vcl_widget_definition_reader_test.mk
CustomTarget_gtk3_kde5_moc.mk
CustomTarget_kf5_moc.mk
CustomTarget_kf6_moc.mk
CustomTarget_nativecalc.mk
CustomTarget_nativecore.mk
CustomTarget_nativedraw.mk
CustomTarget_nativemath.mk
CustomTarget_nativewriter.mk
CustomTarget_qt5_moc.mk
CustomTarget_qt6_moc.mk
Executable_602fuzzer.mk
Executable_bmpfuzzer.mk
Executable_cgmfuzzer.mk
Executable_dbffuzzer.mk
Executable_diffuzzer.mk
Executable_docxfuzzer.mk
Executable_dxffuzzer.mk
Executable_epsfuzzer.mk
Executable_fftester.mk
Executable_fodpfuzzer.mk
Executable_fodsfuzzer.mk
Executable_fodt2pdffuzzer.mk
Executable_fodtfuzzer.mk
Executable_giffuzzer.mk
Executable_htmlfuzzer.mk
Executable_hwpfuzzer.mk
Executable_icontest.mk
Executable_jpgfuzzer.mk
Executable_listfonts.mk
Executable_listglyphs.mk
Executable_lo_kde5filepicker.mk
Executable_lwpfuzzer.mk
Executable_metfuzzer.mk
Executable_minvcl.mk
Executable_mmlfuzzer.mk
Executable_mtfdemo.mk
Executable_mtpfuzzer.mk
Executable_olefuzzer.mk
Executable_pcdfuzzer.mk
Executable_pctfuzzer.mk
Executable_pcxfuzzer.mk
Executable_pngfuzzer.mk
Executable_ppmfuzzer.mk
Executable_pptfuzzer.mk
Executable_pptxfuzzer.mk
Executable_psdfuzzer.mk
Executable_qpwfuzzer.mk
Executable_rasfuzzer.mk
Executable_rtffuzzer.mk
Executable_scrtffuzzer.mk
Executable_sftfuzzer.mk
Executable_slkfuzzer.mk
Executable_svdemo.mk
Executable_svgfuzzer.mk
Executable_svmfuzzer.mk
Executable_svpclient.mk
Executable_svptest.mk
Executable_tgafuzzer.mk
Executable_tiffuzzer.mk
Executable_vcldemo.mk
Executable_visualbackendtest.mk
Executable_webpfuzzer.mk
Executable_wksfuzzer.mk
Executable_wmffuzzer.mk
Executable_ww2fuzzer.mk
Executable_ww6fuzzer.mk
Executable_ww8fuzzer.mk
Executable_xbmfuzzer.mk
Executable_xlsfuzzer.mk
Executable_xlsxfuzzer.mk
Executable_xpmfuzzer.mk
Executable_zipfuzzer.mk
IwyuFilter_vcl.yaml
Library_desktop_detector.mk
Library_vcl.mk tdf#152571 speedup slow draw file save 2023-10-27 22:03:24 +02:00
Library_vclplug_gen.mk
Library_vclplug_gtk3.mk
Library_vclplug_gtk3_kde5.mk
Library_vclplug_gtk4.mk
Library_vclplug_kf5.mk
Library_vclplug_kf6.mk
Library_vclplug_osx.mk
Library_vclplug_qt5.mk
Library_vclplug_qt6.mk
Library_vclplug_win.mk
Makefile
Module_vcl.mk CppunitTest_vcl_pdfexport: split into two 2023-10-31 08:42:56 +01:00
Package_fontunxppds.mk
Package_fontunxpsprint.mk
Package_opengl_denylist.mk
Package_osxres.mk
Package_skia_denylist.mk
Package_theme_definitions.mk
Package_tipoftheday.mk
Package_toolbarmode.mk
README.GDIMetaFile.md
README.lifecycle.md
README.md
README.scheduler.md
README.vars.md Extend SAL_NON_APPLICATION_FONT_USE documentation 2023-10-24 11:06:42 +02:00
StaticLibrary_fuzzer_calc.mk
StaticLibrary_fuzzer_core.mk
StaticLibrary_fuzzer_draw.mk
StaticLibrary_fuzzer_math.mk
StaticLibrary_fuzzer_writer.mk
StaticLibrary_vclmain.mk
UIConfig_vcl.mk
vcl.common.component
vcl.common.component.android
vcl.common.component.headless
vcl.common.component.ios
vcl.common.component.macosx
vcl.common.component.unx
vcl.common.component.windows
vclplug_win.component
WinResTarget_vcl.mk

Visual Class Library (VCL)

Visual Class Library (VCL) is responsible for the widgets (windowing, buttons, controls, file-pickers etc.), operating system abstraction, including basic rendering (e.g. the output device).

It should not be confused with Borland's Visual Component Library, which is entirely unrelated.

VCL provides a graphical toolkit similar to gtk+, Qt, SWING etc.

  • source/

    • the main cross-platform chunk of source
  • inc/

    • cross-platform abstraction headers
  • headless/

    • a backend renderer that draws to bitmaps
  • android/

    • Android backend
  • osx/

    • macOS backend
  • ios/

    • iOS backend
  • quartz/

    • code common to macOS and iOS
  • win/

    • Windows backend
  • qt5/

    • Qt5 (under construction)
  • unx/

  • How the platform abstraction works

    • InitVCL calls 'CreateSalInstance'
      • this is implemented by the compiled platform backends
    • the SalInstance vtable is the primary outward facing gateway API for platform backends
      • It is a factory for: SalFrames, SalVirtualDevices, SalPrinters, Timers, the SolarMutex, Drag&Drop and other objects, as well as the primary event loop wrapper.

Note: references to "SV" in the code mean StarView, which was a portable C++ class library for GUIs, with very old roots, that was developed by StarDivision. Nowadays it is not used by anything except LibreOffice (and OpenOffice).

"svp" stands for "StarView Plugin".

SalData implementations

Each backend must provide an implementation of the SalData class. There is no defined interface, so feel free to implement whatever suits your platform.

If your platform does font handling based on Freetype and Fontconfig, it's highly recommended to use GenericUnixSalData as the base class; there isn't really much *nix stuff in it.

Currently Windows, iOS and MacOSX have independent SalData implementations.

COM Threading

The way COM is used in LO generally:

  • vcl puts main thread into Single-threaded Apartment (STA)
  • oslWorkerWrapperFunction() puts every thread spawned via oslCreateThread() into MTA (free-threaded)

GDIMetafile

GDIMetafile is a vector drawing representation that corresponds directly to the SVM (StarView Metafile) format; it is extremely important as an intermediate format in all sorts of drawing and printing operations.

There is a class MetafileXmlDump in include/vcl/mtfxmldump.hxx that can store a GDIMetafile as XML, which makes debugging much easier since you can just use "diff" to see changes.

EMF+

emf+ is vector file format used by MSO and is successor of wmf and emf formats. see http://msdn.microsoft.com/en-us/library/cc230724.aspx for documentation. note that we didn't have this documentation from start, so part of the code predates to the time when we had guessed some parts and can be enhanced today. there also still many thing not complete

emf+ is handled a bit differently compared to original emf/wmf files, because GDIMetafile is missing features we need (mostly related to transparency, argb colors, etc.)

emf/wmf is translated to GDIMetafile in import filter vcl/source/filter/wmf and so special handling ends here

emf+ is encapsulated into GDIMetafile inside comment records and parsed/rendered later, when it reaches cppcanvas. It is parsed and rendered in cppcanvas/source/mtfrenderer. also note that there are emf+-only and emf+-dual files. dual files contains both types of records (emf and emf+) for rendering the images. these can used also in applications which don't know emf+. in that case we must ignore emf records and use emf+ for rendering. for more details see the documentation.

Parsing

wmf/emf filter --> GDI metafile with emf+ in comments --> cppcanvas metafile renderer

lately the GDIMetafile rendering path changed which also influenced emf+ rendering. now many things happen in drawing layer, where GDIMetafile is translated into drawing layer primitives. for metafiles with emf+ we let the mtfrenderer render them into bitmap (with transparency) and use this bitmap in drawinlayer. cleaner solution for current state would be to extend the drawing layer for missing features and move parsing into drawing layer (might be quite a lot of work). intermediary enhancement would be to know better the needed size/resolution of the bitmap, before we render emf+ into bitmap in drawing layer. Thorsten is working on the same problem with svg rendering, so hopefully his approach could be extended for emf+ as well. the places in drawing layer where we use canvas mtfrenderer to render into bitmaps can be found when you grep for GetUseCanvas. also look at vcl/source/gdi/gdimetafile.cxx where you can look for UseCanvas again. moving the parsing into drawinglayer might also have nice side effect for emf+-dual metafiles. in case the emf+ records are broken, it would be easier to use the duplicit emf rendering. fortunately we didn't run into such a broken emf+ file yet. but there were already few cases where we first though that the problem might be because of broken emf+ part. so far it always turned out to be another problem.

Rendering

before

vcl --> cppcanvas metafile renderer --> vcl

now

drawing layer --> vcl --> cppcanvas metafile renderer --> vcl --> drawing layer

another interesting part is actual rendering into canvas bitmap and using that bitmap later in code using vcl API.

EMF+ implementation has some extensive logging, best if you do a dbgutil build, and then

export SAL_LOG=+INFO.cppcanvas.emf+INFO.vcl.emf

before running LibreOffice; it will give you lots of useful hints.

You can also fallback to EMF (from EMF+) rendering via

export EMF_PLUS_DISABLE=1

Printing/PDF Export

Printing from Writer works like this:

  1. individual pages print by passing an appropriate OutputDevice to XRenderable
  2. in drawinglayer, a VclMetafileProcessor2D is used to record everything on the page (because the OutputDevice has been set up to record a GDIMetaFile)
  3. the pages' GDIMetaFiles are converted to PDF by the vcl::PDFWriter in vcl/source/gdi/pdfwriter*

Creating the ODF thumbnail for the first page works as above except step 3 is:

  1. the GDIMetaFile is replayed to create the thumbnail

On-screen display differs in step 1 and 2:

  1. the VCL Window gets invalidated somehow and paints itself
  2. in drawinglayer, a VclPixelProcessor2D is used to display the content

Debugging PDF export

Debugging the PDF export becomes much easier when compression is disabled (so the PDF file is directly readable) and the MARK function puts comments into the PDF file about which method generated the following PDF content.

The compression can be disabled even using an env. var:

export VCL_DEBUG_DISABLE_PDFCOMPRESSION=1

To de-compress the contents of a PDF file written by a release build or other programs, use the "pdfunzip" tool:

bin/run pdfunzip input.pdf output.pdf

SolarMutexGuard

The solar mutex is the "big kernel lock" of LibreOffice, a global one. It's a recursive mutex, so it's allowed to take the lock on the same thread multiple times, and only the last unlock will actually release the mutex.

UNO methods on components can be called from multiple threads, while the majority of the codebase is not prepared for multi-threading. One way to get around this mismatch is to create a SolarMutexGuard instance at the start of each & every UNO method implementation, but only when it is necessary:

  • Only acquire the SolarMutex if you actually need it (e.g., not in functions that return static information).

  • Only around the code that actually needs it (i.e., never call out with it locked).

This way you ensure that code (not prepared for multithreading) is still executed only on a single thread.

In case you expect that your caller takes the solar mutex, then you can use the DBG_TESTSOLARMUTEX() macro to assert that in dbgutil builds.

Event listeners are a special (but frequent) case of the "never call out with a mutex (SolarMutex or other) locked" fundamental rule:

  • UNO methods can be called from multiple threads, so most implementations take the solar mutex as their first action when necessary.

  • This can be problematic if later calling out (an event handler is called), where the called function may be an UNO method implementation as well and may be invoked on a different thread.

  • So we try to not own the solar mutex, whenever we call out (invoke event listeners).

In short, never hold any mutex unless necessary, especially not when calling out.

Read More