Sampling Query Profiler

ClickHouse runs sampling profiler that allows analyzing query execution. Using profiler you can find source code routines that used the most frequently during query execution. You can trace CPU time and wall-clock time spent including idle time.

To use profiler:

  • Setup the trace_log section of the server configuration.

    This section configures the trace_log system table containing the results of the profiler functioning. It is configured by default. Remember that data in this table is valid only for a running server. After the server restart, ClickHouse does not clean up the table and all the stored virtual memory address may become invalid.

  • Setup the query_profiler_cpu_time_period_ns or query_profiler_real_time_period_ns settings. Both settings can be used simultaneously.

    These settings allow you to configure profiler timers. As these are the session settings, you can get different sampling frequency for the whole server, individual users or user profiles, for your interactive session, and for each individual query.

The default sampling frequency is one sample per second and both CPU and real timers are enabled. This frequency allows collecting enough information about ClickHouse cluster. At the same time, working with this frequency, profiler does not affect ClickHouse server’s performance. If you need to profile each individual query try to use higher sampling frequency.

To analyze the trace_log system table:

  • Install the clickhouse-common-static-dbg package. See Install from DEB Packages.

  • Allow introspection functions by the allow_introspection_functions setting.

    For security reasons, introspection functions are disabled by default.

  • Use the addressToLine, addressToSymbol and demangle introspection functions to get function names and their positions in ClickHouse code. To get a profile for some query, you need to aggregate data from the trace_log table. You can aggregate data by individual functions or by the whole stack traces.

If you need to visualize trace_log info, try flamegraph and speedscope.

Example

In this example we:

  • Filtering trace_log data by a query identifier and the current date.

  • Aggregating by stack trace.

  • Using introspection functions, we will get a report of:

    • Names of symbols and corresponding source code functions.
    • Source code locations of these functions.
  1. SELECT
  2. count(),
  3. arrayStringConcat(arrayMap(x -> concat(demangle(addressToSymbol(x)), '\n ', addressToLine(x)), trace), '\n') AS sym
  4. FROM system.trace_log
  5. WHERE (query_id = 'ebca3574-ad0a-400a-9cbc-dca382f5998c') AND (event_date = today())
  6. GROUP BY trace
  7. ORDER BY count() DESC
  8. LIMIT 10
  1. Row 1:
  2. ──────
  3. count(): 6344
  4. sym: StackTrace::StackTrace(ucontext_t const&)
  5. /home/milovidov/ClickHouse/build_gcc9/../src/Common/StackTrace.cpp:208
  6. DB::(anonymous namespace)::writeTraceInfo(DB::TimerType, int, siginfo_t*, void*) [clone .isra.0]
  7. /home/milovidov/ClickHouse/build_gcc9/../src/IO/BufferBase.h:99
  8. read
  9. DB::ReadBufferFromFileDescriptor::nextImpl()
  10. /home/milovidov/ClickHouse/build_gcc9/../src/IO/ReadBufferFromFileDescriptor.cpp:56
  11. DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&)
  12. /home/milovidov/ClickHouse/build_gcc9/../src/IO/ReadBuffer.h:54
  13. DB::CompressedReadBufferFromFile::nextImpl()
  14. /home/milovidov/ClickHouse/build_gcc9/../src/Compression/CompressedReadBufferFromFile.cpp:22
  15. DB::CompressedReadBufferFromFile::seek(unsigned long, unsigned long)
  16. /home/milovidov/ClickHouse/build_gcc9/../src/Compression/CompressedReadBufferFromFile.cpp:63
  17. DB::MergeTreeReaderStream::seekToMark(unsigned long)
  18. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeReaderStream.cpp:200
  19. std::_Function_handler<DB::ReadBuffer* (std::vector<DB::IDataType::Substream, std::allocator<DB::IDataType::Substream> > const&), DB::MergeTreeReader::readData(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, DB::IDataType const&, DB::IColumn&, unsigned long, bool, unsigned long, bool)::{lambda(bool)#1}::operator()(bool) const::{lambda(std::vector<DB::IDataType::Substream, std::allocator<DB::IDataType::Substream> > const&)#1}>::_M_invoke(std::_Any_data const&, std::vector<DB::IDataType::Substream, std::allocator<DB::IDataType::Substream> > const&)
  20. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeReader.cpp:212
  21. DB::IDataType::deserializeBinaryBulkWithMultipleStreams(DB::IColumn&, unsigned long, DB::IDataType::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::IDataType::DeserializeBinaryBulkState>&) const
  22. /usr/local/include/c++/9.1.0/bits/std_function.h:690
  23. DB::MergeTreeReader::readData(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, DB::IDataType const&, DB::IColumn&, unsigned long, bool, unsigned long, bool)
  24. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeReader.cpp:232
  25. DB::MergeTreeReader::readRows(unsigned long, bool, unsigned long, DB::Block&)
  26. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeReader.cpp:111
  27. DB::MergeTreeRangeReader::DelayedStream::finalize(DB::Block&)
  28. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:35
  29. DB::MergeTreeRangeReader::continueReadingChain(DB::MergeTreeRangeReader::ReadResult&)
  30. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:219
  31. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  32. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:487
  33. DB::MergeTreeBaseSelectBlockInputStream::readFromPartImpl()
  34. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeBaseSelectBlockInputStream.cpp:158
  35. DB::MergeTreeBaseSelectBlockInputStream::readImpl()
  36. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  37. DB::IBlockInputStream::read()
  38. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  39. DB::ExpressionBlockInputStream::readImpl()
  40. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ExpressionBlockInputStream.cpp:34
  41. DB::IBlockInputStream::read()
  42. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  43. DB::PartialSortingBlockInputStream::readImpl()
  44. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/PartialSortingBlockInputStream.cpp:13
  45. DB::IBlockInputStream::read()
  46. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  47. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::loop(unsigned long)
  48. /usr/local/include/c++/9.1.0/bits/atomic_base.h:419
  49. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::thread(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long)
  50. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ParallelInputsProcessor.h:215
  51. ThreadFromGlobalPool::ThreadFromGlobalPool<void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*, std::shared_ptr<DB::ThreadGroupStatus>, unsigned long&>(void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*&&)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*&&, std::shared_ptr<DB::ThreadGroupStatus>&&, unsigned long&)::{lambda()#1}::operator()() const
  52. /usr/local/include/c++/9.1.0/bits/shared_ptr_base.h:729
  53. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>)
  54. /usr/local/include/c++/9.1.0/bits/unique_lock.h:69
  55. execute_native_thread_routine
  56. /home/milovidov/ClickHouse/ci/workspace/gcc/gcc-build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:81
  57. start_thread
  58. __clone
  59. Row 2:
  60. ──────
  61. count(): 3295
  62. sym: StackTrace::StackTrace(ucontext_t const&)
  63. /home/milovidov/ClickHouse/build_gcc9/../src/Common/StackTrace.cpp:208
  64. DB::(anonymous namespace)::writeTraceInfo(DB::TimerType, int, siginfo_t*, void*) [clone .isra.0]
  65. /home/milovidov/ClickHouse/build_gcc9/../src/IO/BufferBase.h:99
  66. __pthread_cond_wait
  67. std::condition_variable::wait(std::unique_lock<std::mutex>&)
  68. /home/milovidov/ClickHouse/ci/workspace/gcc/gcc-build/x86_64-pc-linux-gnu/libstdc++-v3/src/c++11/../../../../../gcc-9.1.0/libstdc++-v3/src/c++11/condition_variable.cc:55
  69. Poco::Semaphore::wait()
  70. /home/milovidov/ClickHouse/build_gcc9/../contrib/poco/Foundation/src/Semaphore.cpp:61
  71. DB::UnionBlockInputStream::readImpl()
  72. /usr/local/include/c++/9.1.0/x86_64-pc-linux-gnu/bits/gthr-default.h:748
  73. DB::IBlockInputStream::read()
  74. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  75. DB::MergeSortingBlockInputStream::readImpl()
  76. /home/milovidov/ClickHouse/build_gcc9/../src/Core/Block.h:90
  77. DB::IBlockInputStream::read()
  78. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  79. DB::ExpressionBlockInputStream::readImpl()
  80. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ExpressionBlockInputStream.cpp:34
  81. DB::IBlockInputStream::read()
  82. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  83. DB::LimitBlockInputStream::readImpl()
  84. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  85. DB::IBlockInputStream::read()
  86. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  87. DB::AsynchronousBlockInputStream::calculate()
  88. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  89. std::_Function_handler<void (), DB::AsynchronousBlockInputStream::next()::{lambda()#1}>::_M_invoke(std::_Any_data const&)
  90. /usr/local/include/c++/9.1.0/bits/atomic_base.h:551
  91. ThreadPoolImpl<ThreadFromGlobalPool>::worker(std::_List_iterator<ThreadFromGlobalPool>)
  92. /usr/local/include/c++/9.1.0/x86_64-pc-linux-gnu/bits/gthr-default.h:748
  93. ThreadFromGlobalPool::ThreadFromGlobalPool<ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::function<void ()>, int, std::optional<unsigned long>)::{lambda()#3}>(ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::function<void ()>, int, std::optional<unsigned long>)::{lambda()#3}&&)::{lambda()#1}::operator()() const
  94. /home/milovidov/ClickHouse/build_gcc9/../src/Common/ThreadPool.h:146
  95. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>)
  96. /usr/local/include/c++/9.1.0/bits/unique_lock.h:69
  97. execute_native_thread_routine
  98. /home/milovidov/ClickHouse/ci/workspace/gcc/gcc-build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:81
  99. start_thread
  100. __clone
  101. Row 3:
  102. ──────
  103. count(): 1978
  104. sym: StackTrace::StackTrace(ucontext_t const&)
  105. /home/milovidov/ClickHouse/build_gcc9/../src/Common/StackTrace.cpp:208
  106. DB::(anonymous namespace)::writeTraceInfo(DB::TimerType, int, siginfo_t*, void*) [clone .isra.0]
  107. /home/milovidov/ClickHouse/build_gcc9/../src/IO/BufferBase.h:99
  108. DB::VolnitskyBase<true, true, DB::StringSearcher<true, true> >::search(unsigned char const*, unsigned long) const
  109. /opt/milovidov/ClickHouse/build_gcc9/programs/clickhouse
  110. DB::MatchImpl<true, false>::vector_constant(DB::PODArray<unsigned char, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul> const&, DB::PODArray<unsigned long, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul> const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, DB::PODArray<unsigned char, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul>&)
  111. /opt/milovidov/ClickHouse/build_gcc9/programs/clickhouse
  112. DB::FunctionsStringSearch<DB::MatchImpl<true, false>, DB::NameLike>::executeImpl(DB::Block&, std::vector<unsigned long, std::allocator<unsigned long> > const&, unsigned long, unsigned long)
  113. /opt/milovidov/ClickHouse/build_gcc9/programs/clickhouse
  114. DB::PreparedFunctionImpl::execute(DB::Block&, std::vector<unsigned long, std::allocator<unsigned long> > const&, unsigned long, unsigned long, bool)
  115. /home/milovidov/ClickHouse/build_gcc9/../src/Functions/IFunction.cpp:464
  116. DB::ExpressionAction::execute(DB::Block&, bool) const
  117. /usr/local/include/c++/9.1.0/bits/stl_vector.h:677
  118. DB::ExpressionActions::execute(DB::Block&, bool) const
  119. /home/milovidov/ClickHouse/build_gcc9/../src/Interpreters/ExpressionActions.cpp:739
  120. DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&)
  121. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:660
  122. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  123. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:546
  124. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  125. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  126. DB::MergeTreeBaseSelectBlockInputStream::readFromPartImpl()
  127. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeBaseSelectBlockInputStream.cpp:158
  128. DB::MergeTreeBaseSelectBlockInputStream::readImpl()
  129. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  130. DB::IBlockInputStream::read()
  131. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  132. DB::ExpressionBlockInputStream::readImpl()
  133. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ExpressionBlockInputStream.cpp:34
  134. DB::IBlockInputStream::read()
  135. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  136. DB::PartialSortingBlockInputStream::readImpl()
  137. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/PartialSortingBlockInputStream.cpp:13
  138. DB::IBlockInputStream::read()
  139. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  140. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::loop(unsigned long)
  141. /usr/local/include/c++/9.1.0/bits/atomic_base.h:419
  142. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::thread(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long)
  143. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ParallelInputsProcessor.h:215
  144. ThreadFromGlobalPool::ThreadFromGlobalPool<void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*, std::shared_ptr<DB::ThreadGroupStatus>, unsigned long&>(void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*&&)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*&&, std::shared_ptr<DB::ThreadGroupStatus>&&, unsigned long&)::{lambda()#1}::operator()() const
  145. /usr/local/include/c++/9.1.0/bits/shared_ptr_base.h:729
  146. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>)
  147. /usr/local/include/c++/9.1.0/bits/unique_lock.h:69
  148. execute_native_thread_routine
  149. /home/milovidov/ClickHouse/ci/workspace/gcc/gcc-build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:81
  150. start_thread
  151. __clone
  152. Row 4:
  153. ──────
  154. count(): 1913
  155. sym: StackTrace::StackTrace(ucontext_t const&)
  156. /home/milovidov/ClickHouse/build_gcc9/../src/Common/StackTrace.cpp:208
  157. DB::(anonymous namespace)::writeTraceInfo(DB::TimerType, int, siginfo_t*, void*) [clone .isra.0]
  158. /home/milovidov/ClickHouse/build_gcc9/../src/IO/BufferBase.h:99
  159. DB::VolnitskyBase<true, true, DB::StringSearcher<true, true> >::search(unsigned char const*, unsigned long) const
  160. /opt/milovidov/ClickHouse/build_gcc9/programs/clickhouse
  161. DB::MatchImpl<true, false>::vector_constant(DB::PODArray<unsigned char, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul> const&, DB::PODArray<unsigned long, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul> const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, DB::PODArray<unsigned char, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul>&)
  162. /opt/milovidov/ClickHouse/build_gcc9/programs/clickhouse
  163. DB::FunctionsStringSearch<DB::MatchImpl<true, false>, DB::NameLike>::executeImpl(DB::Block&, std::vector<unsigned long, std::allocator<unsigned long> > const&, unsigned long, unsigned long)
  164. /opt/milovidov/ClickHouse/build_gcc9/programs/clickhouse
  165. DB::PreparedFunctionImpl::execute(DB::Block&, std::vector<unsigned long, std::allocator<unsigned long> > const&, unsigned long, unsigned long, bool)
  166. /home/milovidov/ClickHouse/build_gcc9/../src/Functions/IFunction.cpp:464
  167. DB::ExpressionAction::execute(DB::Block&, bool) const
  168. /usr/local/include/c++/9.1.0/bits/stl_vector.h:677
  169. DB::ExpressionActions::execute(DB::Block&, bool) const
  170. /home/milovidov/ClickHouse/build_gcc9/../src/Interpreters/ExpressionActions.cpp:739
  171. DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&)
  172. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:660
  173. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  174. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:546
  175. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  176. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  177. DB::MergeTreeBaseSelectBlockInputStream::readFromPartImpl()
  178. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeBaseSelectBlockInputStream.cpp:158
  179. DB::MergeTreeBaseSelectBlockInputStream::readImpl()
  180. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  181. DB::IBlockInputStream::read()
  182. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  183. DB::ExpressionBlockInputStream::readImpl()
  184. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ExpressionBlockInputStream.cpp:34
  185. DB::IBlockInputStream::read()
  186. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  187. DB::PartialSortingBlockInputStream::readImpl()
  188. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/PartialSortingBlockInputStream.cpp:13
  189. DB::IBlockInputStream::read()
  190. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  191. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::loop(unsigned long)
  192. /usr/local/include/c++/9.1.0/bits/atomic_base.h:419
  193. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::thread(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long)
  194. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ParallelInputsProcessor.h:215
  195. ThreadFromGlobalPool::ThreadFromGlobalPool<void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*, std::shared_ptr<DB::ThreadGroupStatus>, unsigned long&>(void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*&&)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*&&, std::shared_ptr<DB::ThreadGroupStatus>&&, unsigned long&)::{lambda()#1}::operator()() const
  196. /usr/local/include/c++/9.1.0/bits/shared_ptr_base.h:729
  197. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>)
  198. /usr/local/include/c++/9.1.0/bits/unique_lock.h:69
  199. execute_native_thread_routine
  200. /home/milovidov/ClickHouse/ci/workspace/gcc/gcc-build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:81
  201. start_thread
  202. __clone
  203. Row 5:
  204. ──────
  205. count(): 1672
  206. sym: StackTrace::StackTrace(ucontext_t const&)
  207. /home/milovidov/ClickHouse/build_gcc9/../src/Common/StackTrace.cpp:208
  208. DB::(anonymous namespace)::writeTraceInfo(DB::TimerType, int, siginfo_t*, void*) [clone .isra.0]
  209. /home/milovidov/ClickHouse/build_gcc9/../src/IO/BufferBase.h:99
  210. DB::VolnitskyBase<true, true, DB::StringSearcher<true, true> >::search(unsigned char const*, unsigned long) const
  211. /opt/milovidov/ClickHouse/build_gcc9/programs/clickhouse
  212. DB::MatchImpl<true, false>::vector_constant(DB::PODArray<unsigned char, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul> const&, DB::PODArray<unsigned long, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul> const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, DB::PODArray<unsigned char, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul>&)
  213. /opt/milovidov/ClickHouse/build_gcc9/programs/clickhouse
  214. DB::FunctionsStringSearch<DB::MatchImpl<true, false>, DB::NameLike>::executeImpl(DB::Block&, std::vector<unsigned long, std::allocator<unsigned long> > const&, unsigned long, unsigned long)
  215. /opt/milovidov/ClickHouse/build_gcc9/programs/clickhouse
  216. DB::PreparedFunctionImpl::execute(DB::Block&, std::vector<unsigned long, std::allocator<unsigned long> > const&, unsigned long, unsigned long, bool)
  217. /home/milovidov/ClickHouse/build_gcc9/../src/Functions/IFunction.cpp:464
  218. DB::ExpressionAction::execute(DB::Block&, bool) const
  219. /usr/local/include/c++/9.1.0/bits/stl_vector.h:677
  220. DB::ExpressionActions::execute(DB::Block&, bool) const
  221. /home/milovidov/ClickHouse/build_gcc9/../src/Interpreters/ExpressionActions.cpp:739
  222. DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&)
  223. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:660
  224. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  225. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:546
  226. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  227. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  228. DB::MergeTreeBaseSelectBlockInputStream::readFromPartImpl()
  229. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeBaseSelectBlockInputStream.cpp:158
  230. DB::MergeTreeBaseSelectBlockInputStream::readImpl()
  231. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  232. DB::IBlockInputStream::read()
  233. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  234. DB::ExpressionBlockInputStream::readImpl()
  235. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ExpressionBlockInputStream.cpp:34
  236. DB::IBlockInputStream::read()
  237. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  238. DB::PartialSortingBlockInputStream::readImpl()
  239. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/PartialSortingBlockInputStream.cpp:13
  240. DB::IBlockInputStream::read()
  241. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  242. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::loop(unsigned long)
  243. /usr/local/include/c++/9.1.0/bits/atomic_base.h:419
  244. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::thread(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long)
  245. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ParallelInputsProcessor.h:215
  246. ThreadFromGlobalPool::ThreadFromGlobalPool<void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*, std::shared_ptr<DB::ThreadGroupStatus>, unsigned long&>(void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*&&)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*&&, std::shared_ptr<DB::ThreadGroupStatus>&&, unsigned long&)::{lambda()#1}::operator()() const
  247. /usr/local/include/c++/9.1.0/bits/shared_ptr_base.h:729
  248. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>)
  249. /usr/local/include/c++/9.1.0/bits/unique_lock.h:69
  250. execute_native_thread_routine
  251. /home/milovidov/ClickHouse/ci/workspace/gcc/gcc-build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:81
  252. start_thread
  253. __clone
  254. Row 6:
  255. ──────
  256. count(): 1531
  257. sym: StackTrace::StackTrace(ucontext_t const&)
  258. /home/milovidov/ClickHouse/build_gcc9/../src/Common/StackTrace.cpp:208
  259. DB::(anonymous namespace)::writeTraceInfo(DB::TimerType, int, siginfo_t*, void*) [clone .isra.0]
  260. /home/milovidov/ClickHouse/build_gcc9/../src/IO/BufferBase.h:99
  261. read
  262. DB::ReadBufferFromFileDescriptor::nextImpl()
  263. /home/milovidov/ClickHouse/build_gcc9/../src/IO/ReadBufferFromFileDescriptor.cpp:56
  264. DB::CompressedReadBufferBase::readCompressedData(unsigned long&, unsigned long&)
  265. /home/milovidov/ClickHouse/build_gcc9/../src/IO/ReadBuffer.h:54
  266. DB::CompressedReadBufferFromFile::nextImpl()
  267. /home/milovidov/ClickHouse/build_gcc9/../src/Compression/CompressedReadBufferFromFile.cpp:22
  268. void DB::deserializeBinarySSE2<4>(DB::PODArray<unsigned char, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul>&, DB::PODArray<unsigned long, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul>&, DB::ReadBuffer&, unsigned long)
  269. /home/milovidov/ClickHouse/build_gcc9/../src/IO/ReadBuffer.h:53
  270. DB::DataTypeString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const
  271. /home/milovidov/ClickHouse/build_gcc9/../src/DataTypes/DataTypeString.cpp:202
  272. DB::MergeTreeReader::readData(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, DB::IDataType const&, DB::IColumn&, unsigned long, bool, unsigned long, bool)
  273. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeReader.cpp:232
  274. DB::MergeTreeReader::readRows(unsigned long, bool, unsigned long, DB::Block&)
  275. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeReader.cpp:111
  276. DB::MergeTreeRangeReader::DelayedStream::finalize(DB::Block&)
  277. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:35
  278. DB::MergeTreeRangeReader::startReadingChain(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  279. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:219
  280. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  281. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  282. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  283. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  284. DB::MergeTreeBaseSelectBlockInputStream::readFromPartImpl()
  285. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeBaseSelectBlockInputStream.cpp:158
  286. DB::MergeTreeBaseSelectBlockInputStream::readImpl()
  287. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  288. DB::IBlockInputStream::read()
  289. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  290. DB::ExpressionBlockInputStream::readImpl()
  291. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ExpressionBlockInputStream.cpp:34
  292. DB::IBlockInputStream::read()
  293. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  294. DB::PartialSortingBlockInputStream::readImpl()
  295. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/PartialSortingBlockInputStream.cpp:13
  296. DB::IBlockInputStream::read()
  297. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  298. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::loop(unsigned long)
  299. /usr/local/include/c++/9.1.0/bits/atomic_base.h:419
  300. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::thread(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long)
  301. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ParallelInputsProcessor.h:215
  302. ThreadFromGlobalPool::ThreadFromGlobalPool<void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*, std::shared_ptr<DB::ThreadGroupStatus>, unsigned long&>(void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*&&)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*&&, std::shared_ptr<DB::ThreadGroupStatus>&&, unsigned long&)::{lambda()#1}::operator()() const
  303. /usr/local/include/c++/9.1.0/bits/shared_ptr_base.h:729
  304. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>)
  305. /usr/local/include/c++/9.1.0/bits/unique_lock.h:69
  306. execute_native_thread_routine
  307. /home/milovidov/ClickHouse/ci/workspace/gcc/gcc-build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:81
  308. start_thread
  309. __clone
  310. Row 7:
  311. ──────
  312. count(): 1034
  313. sym: StackTrace::StackTrace(ucontext_t const&)
  314. /home/milovidov/ClickHouse/build_gcc9/../src/Common/StackTrace.cpp:208
  315. DB::(anonymous namespace)::writeTraceInfo(DB::TimerType, int, siginfo_t*, void*) [clone .isra.0]
  316. /home/milovidov/ClickHouse/build_gcc9/../src/IO/BufferBase.h:99
  317. DB::VolnitskyBase<true, true, DB::StringSearcher<true, true> >::search(unsigned char const*, unsigned long) const
  318. /opt/milovidov/ClickHouse/build_gcc9/programs/clickhouse
  319. DB::MatchImpl<true, false>::vector_constant(DB::PODArray<unsigned char, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul> const&, DB::PODArray<unsigned long, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul> const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, DB::PODArray<unsigned char, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul>&)
  320. /opt/milovidov/ClickHouse/build_gcc9/programs/clickhouse
  321. DB::FunctionsStringSearch<DB::MatchImpl<true, false>, DB::NameLike>::executeImpl(DB::Block&, std::vector<unsigned long, std::allocator<unsigned long> > const&, unsigned long, unsigned long)
  322. /opt/milovidov/ClickHouse/build_gcc9/programs/clickhouse
  323. DB::PreparedFunctionImpl::execute(DB::Block&, std::vector<unsigned long, std::allocator<unsigned long> > const&, unsigned long, unsigned long, bool)
  324. /home/milovidov/ClickHouse/build_gcc9/../src/Functions/IFunction.cpp:464
  325. DB::ExpressionAction::execute(DB::Block&, bool) const
  326. /usr/local/include/c++/9.1.0/bits/stl_vector.h:677
  327. DB::ExpressionActions::execute(DB::Block&, bool) const
  328. /home/milovidov/ClickHouse/build_gcc9/../src/Interpreters/ExpressionActions.cpp:739
  329. DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&)
  330. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:660
  331. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  332. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:546
  333. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  334. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  335. DB::MergeTreeBaseSelectBlockInputStream::readFromPartImpl()
  336. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeBaseSelectBlockInputStream.cpp:158
  337. DB::MergeTreeBaseSelectBlockInputStream::readImpl()
  338. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  339. DB::IBlockInputStream::read()
  340. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  341. DB::ExpressionBlockInputStream::readImpl()
  342. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ExpressionBlockInputStream.cpp:34
  343. DB::IBlockInputStream::read()
  344. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  345. DB::PartialSortingBlockInputStream::readImpl()
  346. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/PartialSortingBlockInputStream.cpp:13
  347. DB::IBlockInputStream::read()
  348. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  349. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::loop(unsigned long)
  350. /usr/local/include/c++/9.1.0/bits/atomic_base.h:419
  351. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::thread(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long)
  352. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ParallelInputsProcessor.h:215
  353. ThreadFromGlobalPool::ThreadFromGlobalPool<void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*, std::shared_ptr<DB::ThreadGroupStatus>, unsigned long&>(void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*&&)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*&&, std::shared_ptr<DB::ThreadGroupStatus>&&, unsigned long&)::{lambda()#1}::operator()() const
  354. /usr/local/include/c++/9.1.0/bits/shared_ptr_base.h:729
  355. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>)
  356. /usr/local/include/c++/9.1.0/bits/unique_lock.h:69
  357. execute_native_thread_routine
  358. /home/milovidov/ClickHouse/ci/workspace/gcc/gcc-build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:81
  359. start_thread
  360. __clone
  361. Row 8:
  362. ──────
  363. count(): 989
  364. sym: StackTrace::StackTrace(ucontext_t const&)
  365. /home/milovidov/ClickHouse/build_gcc9/../src/Common/StackTrace.cpp:208
  366. DB::(anonymous namespace)::writeTraceInfo(DB::TimerType, int, siginfo_t*, void*) [clone .isra.0]
  367. /home/milovidov/ClickHouse/build_gcc9/../src/IO/BufferBase.h:99
  368. __lll_lock_wait
  369. pthread_mutex_lock
  370. DB::MergeTreeReaderStream::loadMarks()
  371. /usr/local/include/c++/9.1.0/bits/std_mutex.h:103
  372. DB::MergeTreeReaderStream::MergeTreeReaderStream(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> > const&, DB::MarkCache*, bool, DB::UncompressedCache*, unsigned long, unsigned long, unsigned long, DB::MergeTreeIndexGranularityInfo const*, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)
  373. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeReaderStream.cpp:107
  374. std::_Function_handler<void (std::vector<DB::IDataType::Substream, std::allocator<DB::IDataType::Substream> > const&), DB::MergeTreeReader::addStreams(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, DB::IDataType const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::{lambda(std::vector<DB::IDataType::Substream, std::allocator<DB::IDataType::Substream> > const&)#1}>::_M_invoke(std::_Any_data const&, std::vector<DB::IDataType::Substream, std::allocator<DB::IDataType::Substream> > const&)
  375. /usr/local/include/c++/9.1.0/bits/unique_ptr.h:147
  376. DB::MergeTreeReader::addStreams(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, DB::IDataType const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)
  377. /usr/local/include/c++/9.1.0/bits/stl_vector.h:677
  378. DB::MergeTreeReader::MergeTreeReader(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::shared_ptr<DB::MergeTreeDataPart const> const&, DB::NamesAndTypesList const&, DB::UncompressedCache*, DB::MarkCache*, bool, DB::MergeTreeData const&, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> > const&, unsigned long, unsigned long, std::map<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, double, std::less<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::allocator<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const, double> > > const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)
  379. /usr/local/include/c++/9.1.0/bits/stl_list.h:303
  380. DB::MergeTreeThreadSelectBlockInputStream::getNewTask()
  381. /usr/local/include/c++/9.1.0/bits/std_function.h:259
  382. DB::MergeTreeBaseSelectBlockInputStream::readImpl()
  383. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeBaseSelectBlockInputStream.cpp:54
  384. DB::IBlockInputStream::read()
  385. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  386. DB::ExpressionBlockInputStream::readImpl()
  387. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ExpressionBlockInputStream.cpp:34
  388. DB::IBlockInputStream::read()
  389. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  390. DB::PartialSortingBlockInputStream::readImpl()
  391. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/PartialSortingBlockInputStream.cpp:13
  392. DB::IBlockInputStream::read()
  393. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  394. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::loop(unsigned long)
  395. /usr/local/include/c++/9.1.0/bits/atomic_base.h:419
  396. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::thread(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long)
  397. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ParallelInputsProcessor.h:215
  398. ThreadFromGlobalPool::ThreadFromGlobalPool<void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*, std::shared_ptr<DB::ThreadGroupStatus>, unsigned long&>(void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*&&)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*&&, std::shared_ptr<DB::ThreadGroupStatus>&&, unsigned long&)::{lambda()#1}::operator()() const
  399. /usr/local/include/c++/9.1.0/bits/shared_ptr_base.h:729
  400. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>)
  401. /usr/local/include/c++/9.1.0/bits/unique_lock.h:69
  402. execute_native_thread_routine
  403. /home/milovidov/ClickHouse/ci/workspace/gcc/gcc-build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:81
  404. start_thread
  405. __clone
  406. Row 9:
  407. ───────
  408. count(): 779
  409. sym: StackTrace::StackTrace(ucontext_t const&)
  410. /home/milovidov/ClickHouse/build_gcc9/../src/Common/StackTrace.cpp:208
  411. DB::(anonymous namespace)::writeTraceInfo(DB::TimerType, int, siginfo_t*, void*) [clone .isra.0]
  412. /home/milovidov/ClickHouse/build_gcc9/../src/IO/BufferBase.h:99
  413. void DB::deserializeBinarySSE2<4>(DB::PODArray<unsigned char, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul>&, DB::PODArray<unsigned long, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul>&, DB::ReadBuffer&, unsigned long)
  414. /usr/local/lib/gcc/x86_64-pc-linux-gnu/9.1.0/include/emmintrin.h:727
  415. DB::DataTypeString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const
  416. /home/milovidov/ClickHouse/build_gcc9/../src/DataTypes/DataTypeString.cpp:202
  417. DB::MergeTreeReader::readData(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, DB::IDataType const&, DB::IColumn&, unsigned long, bool, unsigned long, bool)
  418. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeReader.cpp:232
  419. DB::MergeTreeReader::readRows(unsigned long, bool, unsigned long, DB::Block&)
  420. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeReader.cpp:111
  421. DB::MergeTreeRangeReader::DelayedStream::finalize(DB::Block&)
  422. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:35
  423. DB::MergeTreeRangeReader::startReadingChain(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  424. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:219
  425. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  426. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  427. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  428. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  429. DB::MergeTreeBaseSelectBlockInputStream::readFromPartImpl()
  430. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeBaseSelectBlockInputStream.cpp:158
  431. DB::MergeTreeBaseSelectBlockInputStream::readImpl()
  432. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  433. DB::IBlockInputStream::read()
  434. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  435. DB::ExpressionBlockInputStream::readImpl()
  436. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ExpressionBlockInputStream.cpp:34
  437. DB::IBlockInputStream::read()
  438. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  439. DB::PartialSortingBlockInputStream::readImpl()
  440. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/PartialSortingBlockInputStream.cpp:13
  441. DB::IBlockInputStream::read()
  442. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  443. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::loop(unsigned long)
  444. /usr/local/include/c++/9.1.0/bits/atomic_base.h:419
  445. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::thread(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long)
  446. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ParallelInputsProcessor.h:215
  447. ThreadFromGlobalPool::ThreadFromGlobalPool<void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*, std::shared_ptr<DB::ThreadGroupStatus>, unsigned long&>(void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*&&)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*&&, std::shared_ptr<DB::ThreadGroupStatus>&&, unsigned long&)::{lambda()#1}::operator()() const
  448. /usr/local/include/c++/9.1.0/bits/shared_ptr_base.h:729
  449. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>)
  450. /usr/local/include/c++/9.1.0/bits/unique_lock.h:69
  451. execute_native_thread_routine
  452. /home/milovidov/ClickHouse/ci/workspace/gcc/gcc-build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:81
  453. start_thread
  454. __clone
  455. Row 10:
  456. ───────
  457. count(): 666
  458. sym: StackTrace::StackTrace(ucontext_t const&)
  459. /home/milovidov/ClickHouse/build_gcc9/../src/Common/StackTrace.cpp:208
  460. DB::(anonymous namespace)::writeTraceInfo(DB::TimerType, int, siginfo_t*, void*) [clone .isra.0]
  461. /home/milovidov/ClickHouse/build_gcc9/../src/IO/BufferBase.h:99
  462. void DB::deserializeBinarySSE2<4>(DB::PODArray<unsigned char, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul>&, DB::PODArray<unsigned long, 4096ul, AllocatorWithHint<false, AllocatorHints::DefaultHint, 67108864ul>, 15ul, 16ul>&, DB::ReadBuffer&, unsigned long)
  463. /usr/local/lib/gcc/x86_64-pc-linux-gnu/9.1.0/include/emmintrin.h:727
  464. DB::DataTypeString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const
  465. /home/milovidov/ClickHouse/build_gcc9/../src/DataTypes/DataTypeString.cpp:202
  466. DB::MergeTreeReader::readData(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, DB::IDataType const&, DB::IColumn&, unsigned long, bool, unsigned long, bool)
  467. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeReader.cpp:232
  468. DB::MergeTreeReader::readRows(unsigned long, bool, unsigned long, DB::Block&)
  469. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeReader.cpp:111
  470. DB::MergeTreeRangeReader::DelayedStream::finalize(DB::Block&)
  471. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:35
  472. DB::MergeTreeRangeReader::startReadingChain(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  473. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeRangeReader.cpp:219
  474. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  475. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  476. DB::MergeTreeRangeReader::read(unsigned long, std::vector<DB::MarkRange, std::allocator<DB::MarkRange> >&)
  477. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  478. DB::MergeTreeBaseSelectBlockInputStream::readFromPartImpl()
  479. /home/milovidov/ClickHouse/build_gcc9/../src/Storages/MergeTree/MergeTreeBaseSelectBlockInputStream.cpp:158
  480. DB::MergeTreeBaseSelectBlockInputStream::readImpl()
  481. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  482. DB::IBlockInputStream::read()
  483. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  484. DB::ExpressionBlockInputStream::readImpl()
  485. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ExpressionBlockInputStream.cpp:34
  486. DB::IBlockInputStream::read()
  487. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  488. DB::PartialSortingBlockInputStream::readImpl()
  489. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/PartialSortingBlockInputStream.cpp:13
  490. DB::IBlockInputStream::read()
  491. /usr/local/include/c++/9.1.0/bits/stl_vector.h:108
  492. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::loop(unsigned long)
  493. /usr/local/include/c++/9.1.0/bits/atomic_base.h:419
  494. DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::thread(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long)
  495. /home/milovidov/ClickHouse/build_gcc9/../src/DataStreams/ParallelInputsProcessor.h:215
  496. ThreadFromGlobalPool::ThreadFromGlobalPool<void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*, std::shared_ptr<DB::ThreadGroupStatus>, unsigned long&>(void (DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::*&&)(std::shared_ptr<DB::ThreadGroupStatus>, unsigned long), DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>*&&, std::shared_ptr<DB::ThreadGroupStatus>&&, unsigned long&)::{lambda()#1}::operator()() const
  497. /usr/local/include/c++/9.1.0/bits/shared_ptr_base.h:729
  498. ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>)
  499. /usr/local/include/c++/9.1.0/bits/unique_lock.h:69
  500. execute_native_thread_routine
  501. /home/milovidov/ClickHouse/ci/workspace/gcc/gcc-build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:81
  502. start_thread
  503. __clone