sql-engines.html 43 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511
  1. <!DOCTYPE html>
  2. <html lang="en" data-content_root="../../../">
  3. <head>
  4. <meta charset="utf-8" />
  5. <meta name="viewport" content="width=device-width, initial-scale=1.0" />
  6. <meta name="viewport" content="width=device-width, initial-scale=1">
  7. <title>SQL Engines &#8212; SearXNG Documentation (2025.5.1+1a1628149)</title>
  8. <link rel="stylesheet" type="text/css" href="../../../_static/pygments.css?v=6625fa76" />
  9. <link rel="stylesheet" type="text/css" href="../../../_static/searxng.css?v=52e4ff28" />
  10. <script src="../../../_static/documentation_options.js?v=cc9fc81d"></script>
  11. <script src="../../../_static/doctools.js?v=9a2dae69"></script>
  12. <script src="../../../_static/sphinx_highlight.js?v=dc90522c"></script>
  13. <script data-project="searxng" data-version="2025.5.1+1a1628149" src="../../../_static/describe_version.js?v=fa7f30d0"></script>
  14. <link rel="index" title="Index" href="../../../genindex.html" />
  15. <link rel="search" title="Search" href="../../../search.html" />
  16. <link rel="next" title="Tineye" href="../online_url_search/tineye.html" />
  17. <link rel="prev" title="Local Search APIs" href="search-indexer-engines.html" />
  18. </head><body>
  19. <div class="related" role="navigation" aria-label="Related">
  20. <h3>Navigation</h3>
  21. <ul>
  22. <li class="right" style="margin-right: 10px">
  23. <a href="../../../genindex.html" title="General Index"
  24. accesskey="I">index</a></li>
  25. <li class="right" >
  26. <a href="../../../py-modindex.html" title="Python Module Index"
  27. >modules</a> |</li>
  28. <li class="right" >
  29. <a href="../online_url_search/tineye.html" title="Tineye"
  30. accesskey="N">next</a> |</li>
  31. <li class="right" >
  32. <a href="search-indexer-engines.html" title="Local Search APIs"
  33. accesskey="P">previous</a> |</li>
  34. <li class="nav-item nav-item-0"><a href="../../../index.html">SearXNG Documentation (2025.5.1+1a1628149)</a> &#187;</li>
  35. <li class="nav-item nav-item-1"><a href="../../index.html" >Developer documentation</a> &#187;</li>
  36. <li class="nav-item nav-item-2"><a href="../index.html" accesskey="U">Engine Implementations</a> &#187;</li>
  37. <li class="nav-item nav-item-this"><a href="">SQL Engines</a></li>
  38. </ul>
  39. </div>
  40. <div class="document">
  41. <div class="documentwrapper">
  42. <div class="bodywrapper">
  43. <div class="body" role="main">
  44. <section id="sql-engines">
  45. <span id="id1"></span><h1>SQL Engines<a class="headerlink" href="#sql-engines" title="Link to this heading">¶</a></h1>
  46. <aside class="sidebar">
  47. <p class="sidebar-title">further read</p>
  48. <ul class="simple">
  49. <li><p><a class="reference external" href="https://www.sqlite.org/index.html">SQLite</a></p></li>
  50. <li><p><a class="reference external" href="https://www.postgresql.org">PostgreSQL</a></p></li>
  51. <li><p><a class="reference external" href="https://www.mysql.com">MySQL</a></p></li>
  52. </ul>
  53. </aside>
  54. <nav class="contents local" id="contents">
  55. <ul class="simple">
  56. <li><p><a class="reference internal" href="#extra-dependencies" id="id11">Extra Dependencies</a></p></li>
  57. <li><p><a class="reference internal" href="#configure-the-engines" id="id12">Configure the engines</a></p>
  58. <ul>
  59. <li><p><a class="reference internal" href="#engine-sqlite" id="id13">SQLite</a></p></li>
  60. <li><p><a class="reference internal" href="#engine-postgresql" id="id14">PostgreSQL</a></p></li>
  61. <li><p><a class="reference internal" href="#engine-mysql-server" id="id15">MySQL</a></p></li>
  62. <li><p><a class="reference internal" href="#mariadb" id="id16">MariaDB</a></p></li>
  63. </ul>
  64. </li>
  65. </ul>
  66. </nav>
  67. <aside class="sidebar">
  68. <p class="sidebar-title">info</p>
  69. <p>Initial sponsored by <a class="reference external" href="https://nlnet.nl/discovery">Search and Discovery Fund</a> of <a class="reference external" href="https://nlnet.nl/">NLnet Foundation</a>.</p>
  70. </aside>
  71. <p>With the <em>SQL engines</em> you can bind SQL databases into SearXNG. The following
  72. Relational Database Management System (RDBMS) are supported:</p>
  73. <ul class="simple">
  74. <li><p><a class="reference internal" href="#engine-sqlite"><span class="std std-ref">SQLite</span></a></p></li>
  75. <li><p><a class="reference internal" href="#engine-postgresql"><span class="std std-ref">PostgreSQL</span></a></p></li>
  76. <li><p><a class="reference internal" href="#engine-mysql-server"><span class="std std-ref">MySQL</span></a> &amp; <a class="reference internal" href="#engine-mariadb-server"><span class="std std-ref">MariaDB</span></a></p></li>
  77. </ul>
  78. <p>All of the engines above are just commented out in the <a class="extlink-origin reference external" href="https://github.com/searxng/searxng/blob/master/searx/settings.yml">settings.yml</a>, as you have to set the required attributes for the
  79. engines, e.g. <code class="docutils literal notranslate"><span class="pre">database:</span></code> …</p>
  80. <div class="highlight-yaml notranslate"><div class="highlight"><pre><span></span><span class="p p-Indicator">-</span><span class="w"> </span><span class="nt">name</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">...</span>
  81. <span class="w"> </span><span class="nt">engine</span><span class="p">:</span><span class="w"> </span><span class="p p-Indicator">{</span><span class="nv">sqlite|postgresql|mysql_server</span><span class="p p-Indicator">}</span>
  82. <span class="w"> </span><span class="nt">database</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">...</span>
  83. <span class="w"> </span><span class="nt">result_template</span><span class="p">:</span><span class="w"> </span><span class="p p-Indicator">{</span><span class="nv">template_name</span><span class="p p-Indicator">}</span>
  84. <span class="w"> </span><span class="nt">query_str</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">...</span>
  85. </pre></div>
  86. </div>
  87. <p>By default, the engines use the <code class="docutils literal notranslate"><span class="pre">key-value</span></code> template for displaying results /
  88. see <a class="extlink-origin reference external" href="https://github.com/searxng/searxng/blob/master/searx/templates/simple/result_templates/key-value.html">simple</a>
  89. theme. If you are not satisfied with the original result layout, you can use
  90. your own template, set <code class="docutils literal notranslate"><span class="pre">result_template</span></code> attribute to <code class="docutils literal notranslate"><span class="pre">{template_name}</span></code> and
  91. place the templates at:</p>
  92. <div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">searx</span><span class="o">/</span><span class="n">templates</span><span class="o">/</span><span class="p">{</span><span class="n">theme_name</span><span class="p">}</span><span class="o">/</span><span class="n">result_templates</span><span class="o">/</span><span class="p">{</span><span class="n">template_name</span><span class="p">}</span>
  93. </pre></div>
  94. </div>
  95. <p>If you do not wish to expose these engines on a public instance, you can still
  96. add them and limit the access by setting <code class="docutils literal notranslate"><span class="pre">tokens</span></code> as described in section
  97. <a class="reference internal" href="../../../admin/settings/settings_engines.html#private-engines"><span class="std std-ref">Private Engines (tokens)</span></a>.</p>
  98. <section id="extra-dependencies">
  99. <h2><a class="toc-backref" href="#id11" role="doc-backlink">Extra Dependencies</a><a class="headerlink" href="#extra-dependencies" title="Link to this heading">¶</a></h2>
  100. <p>For using <a class="reference internal" href="#engine-postgresql"><span class="std std-ref">PostgreSQL</span></a> or <a class="reference internal" href="#engine-mysql-server"><span class="std std-ref">MySQL</span></a> you need to
  101. install additional packages in Python’s Virtual Environment of your SearXNG
  102. instance. To switch into the environment (<a class="reference internal" href="../../../admin/installation-searxng.html#searxng-src"><span class="std std-ref">Install SearXNG &amp; dependencies</span></a>) you can use
  103. <a class="reference internal" href="../../../utils/searxng.sh.html#searxng-sh"><span class="std std-ref">utils/searxng.sh</span></a>:</p>
  104. <div class="highlight-default notranslate"><div class="highlight"><pre><span></span>$ sudo utils/searxng.sh instance cmd bash
  105. (searxng-pyenv)$ pip install ...
  106. </pre></div>
  107. </div>
  108. </section>
  109. <section id="configure-the-engines">
  110. <h2><a class="toc-backref" href="#id12" role="doc-backlink">Configure the engines</a><a class="headerlink" href="#configure-the-engines" title="Link to this heading">¶</a></h2>
  111. <p>The configuration of the new database engines are similar. You must put a valid
  112. SQL-SELECT query in <code class="docutils literal notranslate"><span class="pre">query_str</span></code>. At the moment you can only bind at most one
  113. parameter in your query. By setting the attribute <code class="docutils literal notranslate"><span class="pre">limit</span></code> you can define how
  114. many results you want from the SQL server. Basically, it is the same as the
  115. <code class="docutils literal notranslate"><span class="pre">LIMIT</span></code> keyword in SQL.</p>
  116. <p>Please, do not include <code class="docutils literal notranslate"><span class="pre">LIMIT</span></code> or <code class="docutils literal notranslate"><span class="pre">OFFSET</span></code> in your SQL query as the engines
  117. rely on these keywords during paging. If you want to configure the number of
  118. returned results use the option <code class="docutils literal notranslate"><span class="pre">limit</span></code>.</p>
  119. <section id="engine-sqlite">
  120. <span id="id2"></span><h3><a class="toc-backref" href="#id13" role="doc-backlink">SQLite</a><a class="headerlink" href="#engine-sqlite" title="Link to this heading">¶</a></h3>
  121. <aside class="sidebar">
  122. <p class="sidebar-title">info</p>
  123. <ul class="simple">
  124. <li><p><a class="extlink-origin reference external" href="https://github.com/searxng/searxng/blob/master/searx/engines/sqlite.py">sqlite.py</a></p></li>
  125. </ul>
  126. </aside>
  127. <p id="module-searx.engines.sqlite">SQLite is a small, fast and reliable SQL database engine. It does not require
  128. any extra dependency.</p>
  129. <section id="configuration">
  130. <h4>Configuration<a class="headerlink" href="#configuration" title="Link to this heading">¶</a></h4>
  131. <p>The engine has the following (additional) settings:</p>
  132. <ul class="simple">
  133. <li><p><a class="reference internal" href="#searx.engines.sqlite.result_type" title="searx.engines.sqlite.result_type"><code class="xref py py-obj docutils literal notranslate"><span class="pre">result_type</span></code></a></p></li>
  134. </ul>
  135. </section>
  136. <section id="example">
  137. <h4>Example<a class="headerlink" href="#example" title="Link to this heading">¶</a></h4>
  138. <p>To demonstrate the power of database engines, here is a more complex example
  139. which reads from a <a class="reference external" href="https://mediathekview.de/">MediathekView</a> (DE) movie database. For this example of the
  140. SQLite engine download the database:</p>
  141. <ul class="simple">
  142. <li><p><a class="reference external" href="https://liste.mediathekview.de/filmliste-v2.db.bz2">https://liste.mediathekview.de/filmliste-v2.db.bz2</a></p></li>
  143. </ul>
  144. <p>and unpack into <code class="docutils literal notranslate"><span class="pre">searx/data/filmliste-v2.db</span></code>. To search the database use e.g
  145. Query to test: <code class="docutils literal notranslate"><span class="pre">!mediathekview</span> <span class="pre">concert</span></code></p>
  146. <div class="highlight-yaml notranslate"><div class="highlight"><pre><span></span><span class="p p-Indicator">-</span><span class="w"> </span><span class="nt">name</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">mediathekview</span>
  147. <span class="w"> </span><span class="nt">engine</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">sqlite</span>
  148. <span class="w"> </span><span class="nt">shortcut</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">mediathekview</span>
  149. <span class="w"> </span><span class="nt">categories</span><span class="p">:</span><span class="w"> </span><span class="p p-Indicator">[</span><span class="nv">general</span><span class="p p-Indicator">,</span><span class="w"> </span><span class="nv">videos</span><span class="p p-Indicator">]</span>
  150. <span class="w"> </span><span class="nt">result_type</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">MainResult</span>
  151. <span class="w"> </span><span class="nt">database</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">searx/data/filmliste-v2.db</span>
  152. <span class="w"> </span><span class="nt">query_str</span><span class="p">:</span><span class="w"> </span><span class="p p-Indicator">&gt;-</span>
  153. <span class="w"> </span><span class="no">SELECT title || &#39; (&#39; || time(duration, &#39;unixepoch&#39;) || &#39;)&#39; AS title,</span>
  154. <span class="w"> </span><span class="no">COALESCE( NULLIF(url_video_hd,&#39;&#39;), NULLIF(url_video_sd,&#39;&#39;), url_video) AS url,</span>
  155. <span class="w"> </span><span class="no">description AS content</span>
  156. <span class="w"> </span><span class="no">FROM film</span>
  157. <span class="w"> </span><span class="no">WHERE title LIKE :wildcard OR description LIKE :wildcard</span>
  158. <span class="w"> </span><span class="no">ORDER BY duration DESC</span>
  159. </pre></div>
  160. </div>
  161. </section>
  162. <section id="implementations">
  163. <h4>Implementations<a class="headerlink" href="#implementations" title="Link to this heading">¶</a></h4>
  164. </section>
  165. <dl class="py data">
  166. <dt class="sig sig-object py" id="searx.engines.sqlite.database">
  167. <span class="sig-prename descclassname"><span class="pre">searx.engines.sqlite.</span></span><span class="sig-name descname"><span class="pre">database</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.sqlite.database" title="Link to this definition">¶</a></dt>
  168. <dd><p>Filename of the SQLite DB.</p>
  169. </dd></dl>
  170. <dl class="py data">
  171. <dt class="sig sig-object py" id="searx.engines.sqlite.query_str">
  172. <span class="sig-prename descclassname"><span class="pre">searx.engines.sqlite.</span></span><span class="sig-name descname"><span class="pre">query_str</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.sqlite.query_str" title="Link to this definition">¶</a></dt>
  173. <dd><p>SQL query that returns the result items.</p>
  174. </dd></dl>
  175. <dl class="py data">
  176. <dt class="sig sig-object py" id="searx.engines.sqlite.result_type">
  177. <span class="sig-prename descclassname"><span class="pre">searx.engines.sqlite.</span></span><span class="sig-name descname"><span class="pre">result_type</span></span><em class="property"><span class="p"><span class="pre">:</span></span><span class="w"> </span><a class="reference external" href="https://docs.python.org/3/library/typing.html#typing.Literal" title="(in Python v3.13)"><span class="pre">Literal</span></a><span class="p"><span class="pre">[</span></span><span class="s"><span class="pre">'MainResult'</span></span><span class="p"><span class="pre">,</span></span><span class="w"> </span><span class="s"><span class="pre">'KeyValue'</span></span><span class="p"><span class="pre">]</span></span></em><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'KeyValue'</span></em><a class="headerlink" href="#searx.engines.sqlite.result_type" title="Link to this definition">¶</a></dt>
  178. <dd><p>The result type can be <code class="xref py py-obj docutils literal notranslate"><span class="pre">MainResult</span></code> or <code class="xref py py-obj docutils literal notranslate"><span class="pre">KeyValue</span></code>.</p>
  179. </dd></dl>
  180. <dl class="py function">
  181. <dt class="sig sig-object py" id="searx.engines.sqlite.sqlite_cursor">
  182. <span class="sig-prename descclassname"><span class="pre">searx.engines.sqlite.</span></span><span class="sig-name descname"><span class="pre">sqlite_cursor</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="reference internal" href="../../../_modules/searx/engines/sqlite.html#sqlite_cursor"><span class="viewcode-link"><span class="pre">[source]</span></span></a><a class="headerlink" href="#searx.engines.sqlite.sqlite_cursor" title="Link to this definition">¶</a></dt>
  183. <dd><p>Implements a <a class="reference external" href="https://docs.python.org/3/library/contextlib.html#contextlib.contextmanager" title="(in Python v3.13)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">Context</span> <span class="pre">Manager</span></code></a> for a
  184. <a class="reference external" href="https://docs.python.org/3/library/sqlite3.html#sqlite3.Cursor" title="(in Python v3.13)"><code class="xref py py-obj docutils literal notranslate"><span class="pre">sqlite3.Cursor</span></code></a>.</p>
  185. <p>Open database in read only mode: if the database doesn’t exist. The default
  186. mode creates an empty file on the file system. See:</p>
  187. <ul class="simple">
  188. <li><p><a class="reference external" href="https://docs.python.org/3/library/sqlite3.html#sqlite3.connect">https://docs.python.org/3/library/sqlite3.html#sqlite3.connect</a></p></li>
  189. <li><p><a class="reference external" href="https://www.sqlite.org/uri.html">https://www.sqlite.org/uri.html</a></p></li>
  190. </ul>
  191. </dd></dl>
  192. </section>
  193. <section id="engine-postgresql">
  194. <span id="id3"></span><h3><a class="toc-backref" href="#id14" role="doc-backlink">PostgreSQL</a><a class="headerlink" href="#engine-postgresql" title="Link to this heading">¶</a></h3>
  195. <aside class="sidebar">
  196. <p class="sidebar-title">info</p>
  197. <ul class="simple">
  198. <li><p><a class="extlink-origin reference external" href="https://github.com/searxng/searxng/blob/master/searx/engines/postgresql.py">postgresql.py</a></p></li>
  199. <li><p><code class="docutils literal notranslate"><span class="pre">pip</span> <span class="pre">install</span></code> <a class="reference external" href="psycopg2">psycopg2-binary</a></p></li>
  200. </ul>
  201. </aside>
  202. <p id="module-searx.engines.postgresql">PostgreSQL is a powerful and robust open source database. Before configuring
  203. the PostgreSQL engine, you must install the dependency <code class="docutils literal notranslate"><span class="pre">psychopg2</span></code>.</p>
  204. <section id="id4">
  205. <h4>Example<a class="headerlink" href="#id4" title="Link to this heading">¶</a></h4>
  206. <p>Below is an example configuration:</p>
  207. <div class="highlight-yaml notranslate"><div class="highlight"><pre><span></span><span class="p p-Indicator">-</span><span class="w"> </span><span class="nt">name</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">my_database</span>
  208. <span class="w"> </span><span class="nt">engine</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">postgresql</span>
  209. <span class="w"> </span><span class="nt">database</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">my_database</span>
  210. <span class="w"> </span><span class="nt">username</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">searxng</span>
  211. <span class="w"> </span><span class="nt">password</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">password</span>
  212. <span class="w"> </span><span class="nt">query_str</span><span class="p">:</span><span class="w"> </span><span class="s">&#39;SELECT</span><span class="nv"> </span><span class="s">*</span><span class="nv"> </span><span class="s">from</span><span class="nv"> </span><span class="s">my_table</span><span class="nv"> </span><span class="s">WHERE</span><span class="nv"> </span><span class="s">my_column</span><span class="nv"> </span><span class="s">=</span><span class="nv"> </span><span class="s">%(query)s&#39;</span>
  213. </pre></div>
  214. </div>
  215. </section>
  216. <section id="id5">
  217. <h4>Implementations<a class="headerlink" href="#id5" title="Link to this heading">¶</a></h4>
  218. </section>
  219. <dl class="py data">
  220. <dt class="sig sig-object py" id="searx.engines.postgresql.host">
  221. <span class="sig-prename descclassname"><span class="pre">searx.engines.postgresql.</span></span><span class="sig-name descname"><span class="pre">host</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'127.0.0.1'</span></em><a class="headerlink" href="#searx.engines.postgresql.host" title="Link to this definition">¶</a></dt>
  222. <dd><p>Hostname of the DB connector</p>
  223. </dd></dl>
  224. <dl class="py data">
  225. <dt class="sig sig-object py" id="searx.engines.postgresql.port">
  226. <span class="sig-prename descclassname"><span class="pre">searx.engines.postgresql.</span></span><span class="sig-name descname"><span class="pre">port</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'5432'</span></em><a class="headerlink" href="#searx.engines.postgresql.port" title="Link to this definition">¶</a></dt>
  227. <dd><p>Port of the DB connector</p>
  228. </dd></dl>
  229. <dl class="py data">
  230. <dt class="sig sig-object py" id="searx.engines.postgresql.database">
  231. <span class="sig-prename descclassname"><span class="pre">searx.engines.postgresql.</span></span><span class="sig-name descname"><span class="pre">database</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.postgresql.database" title="Link to this definition">¶</a></dt>
  232. <dd><p>Name of the database.</p>
  233. </dd></dl>
  234. <dl class="py data">
  235. <dt class="sig sig-object py" id="searx.engines.postgresql.username">
  236. <span class="sig-prename descclassname"><span class="pre">searx.engines.postgresql.</span></span><span class="sig-name descname"><span class="pre">username</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.postgresql.username" title="Link to this definition">¶</a></dt>
  237. <dd><p>Username for the DB connection.</p>
  238. </dd></dl>
  239. <dl class="py data">
  240. <dt class="sig sig-object py" id="searx.engines.postgresql.password">
  241. <span class="sig-prename descclassname"><span class="pre">searx.engines.postgresql.</span></span><span class="sig-name descname"><span class="pre">password</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.postgresql.password" title="Link to this definition">¶</a></dt>
  242. <dd><p>Password for the DB connection.</p>
  243. </dd></dl>
  244. <dl class="py data">
  245. <dt class="sig sig-object py" id="searx.engines.postgresql.query_str">
  246. <span class="sig-prename descclassname"><span class="pre">searx.engines.postgresql.</span></span><span class="sig-name descname"><span class="pre">query_str</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.postgresql.query_str" title="Link to this definition">¶</a></dt>
  247. <dd><p>SQL query that returns the result items.</p>
  248. </dd></dl>
  249. </section>
  250. <section id="engine-mysql-server">
  251. <span id="id6"></span><h3><a class="toc-backref" href="#id15" role="doc-backlink">MySQL</a><a class="headerlink" href="#engine-mysql-server" title="Link to this heading">¶</a></h3>
  252. <aside class="sidebar">
  253. <p class="sidebar-title">info</p>
  254. <ul class="simple">
  255. <li><p><a class="extlink-origin reference external" href="https://github.com/searxng/searxng/blob/master/searx/engines/mysql_server.py">mysql_server.py</a></p></li>
  256. <li><p><code class="docutils literal notranslate"><span class="pre">pip</span> <span class="pre">install</span></code> <a class="extlink-pypi reference external" href="https://pypi.org/project/mysql-connector-python">mysql-connector-python</a></p></li>
  257. </ul>
  258. </aside>
  259. <p id="module-searx.engines.mysql_server">MySQL is said to be the most popular open source database. Before enabling
  260. MySQL engine, you must install the package <code class="docutils literal notranslate"><span class="pre">mysql-connector-python</span></code>.</p>
  261. <p>The authentication plugin is configurable by setting <code class="docutils literal notranslate"><span class="pre">auth_plugin</span></code> in the
  262. attributes. By default it is set to <code class="docutils literal notranslate"><span class="pre">caching_sha2_password</span></code>.</p>
  263. <section id="id7">
  264. <h4>Example<a class="headerlink" href="#id7" title="Link to this heading">¶</a></h4>
  265. <p>This is an example configuration for querying a MySQL server:</p>
  266. <div class="highlight-yaml notranslate"><div class="highlight"><pre><span></span><span class="p p-Indicator">-</span><span class="w"> </span><span class="nt">name</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">my_database</span>
  267. <span class="w"> </span><span class="nt">engine</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">mysql_server</span>
  268. <span class="w"> </span><span class="nt">database</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">my_database</span>
  269. <span class="w"> </span><span class="nt">username</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">searxng</span>
  270. <span class="w"> </span><span class="nt">password</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">password</span>
  271. <span class="w"> </span><span class="nt">limit</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">5</span>
  272. <span class="w"> </span><span class="nt">query_str</span><span class="p">:</span><span class="w"> </span><span class="s">&#39;SELECT</span><span class="nv"> </span><span class="s">*</span><span class="nv"> </span><span class="s">from</span><span class="nv"> </span><span class="s">my_table</span><span class="nv"> </span><span class="s">WHERE</span><span class="nv"> </span><span class="s">my_column=%(query)s&#39;</span>
  273. </pre></div>
  274. </div>
  275. </section>
  276. <section id="id8">
  277. <h4>Implementations<a class="headerlink" href="#id8" title="Link to this heading">¶</a></h4>
  278. </section>
  279. <dl class="py data">
  280. <dt class="sig sig-object py" id="searx.engines.mysql_server.host">
  281. <span class="sig-prename descclassname"><span class="pre">searx.engines.mysql_server.</span></span><span class="sig-name descname"><span class="pre">host</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'127.0.0.1'</span></em><a class="headerlink" href="#searx.engines.mysql_server.host" title="Link to this definition">¶</a></dt>
  282. <dd><p>Hostname of the DB connector</p>
  283. </dd></dl>
  284. <dl class="py data">
  285. <dt class="sig sig-object py" id="searx.engines.mysql_server.port">
  286. <span class="sig-prename descclassname"><span class="pre">searx.engines.mysql_server.</span></span><span class="sig-name descname"><span class="pre">port</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">3306</span></em><a class="headerlink" href="#searx.engines.mysql_server.port" title="Link to this definition">¶</a></dt>
  287. <dd><p>Port of the DB connector</p>
  288. </dd></dl>
  289. <dl class="py data">
  290. <dt class="sig sig-object py" id="searx.engines.mysql_server.database">
  291. <span class="sig-prename descclassname"><span class="pre">searx.engines.mysql_server.</span></span><span class="sig-name descname"><span class="pre">database</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.mysql_server.database" title="Link to this definition">¶</a></dt>
  292. <dd><p>Name of the database.</p>
  293. </dd></dl>
  294. <dl class="py data">
  295. <dt class="sig sig-object py" id="searx.engines.mysql_server.username">
  296. <span class="sig-prename descclassname"><span class="pre">searx.engines.mysql_server.</span></span><span class="sig-name descname"><span class="pre">username</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.mysql_server.username" title="Link to this definition">¶</a></dt>
  297. <dd><p>Username for the DB connection.</p>
  298. </dd></dl>
  299. <dl class="py data">
  300. <dt class="sig sig-object py" id="searx.engines.mysql_server.password">
  301. <span class="sig-prename descclassname"><span class="pre">searx.engines.mysql_server.</span></span><span class="sig-name descname"><span class="pre">password</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.mysql_server.password" title="Link to this definition">¶</a></dt>
  302. <dd><p>Password for the DB connection.</p>
  303. </dd></dl>
  304. <dl class="py data">
  305. <dt class="sig sig-object py" id="searx.engines.mysql_server.query_str">
  306. <span class="sig-prename descclassname"><span class="pre">searx.engines.mysql_server.</span></span><span class="sig-name descname"><span class="pre">query_str</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.mysql_server.query_str" title="Link to this definition">¶</a></dt>
  307. <dd><p>SQL query that returns the result items.</p>
  308. </dd></dl>
  309. </section>
  310. <section id="mariadb">
  311. <span id="engine-mariadb-server"></span><h3><a class="toc-backref" href="#id16" role="doc-backlink">MariaDB</a><a class="headerlink" href="#mariadb" title="Link to this heading">¶</a></h3>
  312. <aside class="sidebar">
  313. <p class="sidebar-title">info</p>
  314. <ul class="simple">
  315. <li><p><a class="extlink-origin reference external" href="https://github.com/searxng/searxng/blob/master/searx/engines/mariadb_server.py">mariadb_server.py</a></p></li>
  316. <li><p><code class="docutils literal notranslate"><span class="pre">pip</span> <span class="pre">install</span></code> <a class="extlink-pypi reference external" href="https://pypi.org/project/mariadb">mariadb</a></p></li>
  317. </ul>
  318. </aside>
  319. <p id="module-searx.engines.mariadb_server">MariaDB is a community driven fork of MySQL. Before enabling MariaDB engine,
  320. you must the install the pip package <code class="docutils literal notranslate"><span class="pre">mariadb</span></code> along with the necessary
  321. prerequities.</p>
  322. <p><a class="reference external" href="https://mariadb.com/docs/server/connect/programming-languages/c/install/">See the following documentation for more details</a></p>
  323. <section id="id9">
  324. <h4>Example<a class="headerlink" href="#id9" title="Link to this heading">¶</a></h4>
  325. <p>This is an example configuration for querying a MariaDB server:</p>
  326. <div class="highlight-yaml notranslate"><div class="highlight"><pre><span></span><span class="p p-Indicator">-</span><span class="w"> </span><span class="nt">name</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">my_database</span>
  327. <span class="w"> </span><span class="nt">engine</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">mariadb_server</span>
  328. <span class="w"> </span><span class="nt">database</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">my_database</span>
  329. <span class="w"> </span><span class="nt">username</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">searxng</span>
  330. <span class="w"> </span><span class="nt">password</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">password</span>
  331. <span class="w"> </span><span class="nt">limit</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">5</span>
  332. <span class="w"> </span><span class="nt">query_str</span><span class="p">:</span><span class="w"> </span><span class="s">&#39;SELECT</span><span class="nv"> </span><span class="s">*</span><span class="nv"> </span><span class="s">from</span><span class="nv"> </span><span class="s">my_table</span><span class="nv"> </span><span class="s">WHERE</span><span class="nv"> </span><span class="s">my_column=%(query)s&#39;</span>
  333. </pre></div>
  334. </div>
  335. </section>
  336. <section id="id10">
  337. <h4>Implementations<a class="headerlink" href="#id10" title="Link to this heading">¶</a></h4>
  338. </section>
  339. <dl class="py data">
  340. <dt class="sig sig-object py" id="searx.engines.mariadb_server.host">
  341. <span class="sig-prename descclassname"><span class="pre">searx.engines.mariadb_server.</span></span><span class="sig-name descname"><span class="pre">host</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">'127.0.0.1'</span></em><a class="headerlink" href="#searx.engines.mariadb_server.host" title="Link to this definition">¶</a></dt>
  342. <dd><p>Hostname of the DB connector</p>
  343. </dd></dl>
  344. <dl class="py data">
  345. <dt class="sig sig-object py" id="searx.engines.mariadb_server.port">
  346. <span class="sig-prename descclassname"><span class="pre">searx.engines.mariadb_server.</span></span><span class="sig-name descname"><span class="pre">port</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">3306</span></em><a class="headerlink" href="#searx.engines.mariadb_server.port" title="Link to this definition">¶</a></dt>
  347. <dd><p>Port of the DB connector</p>
  348. </dd></dl>
  349. <dl class="py data">
  350. <dt class="sig sig-object py" id="searx.engines.mariadb_server.database">
  351. <span class="sig-prename descclassname"><span class="pre">searx.engines.mariadb_server.</span></span><span class="sig-name descname"><span class="pre">database</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.mariadb_server.database" title="Link to this definition">¶</a></dt>
  352. <dd><p>Name of the database.</p>
  353. </dd></dl>
  354. <dl class="py data">
  355. <dt class="sig sig-object py" id="searx.engines.mariadb_server.username">
  356. <span class="sig-prename descclassname"><span class="pre">searx.engines.mariadb_server.</span></span><span class="sig-name descname"><span class="pre">username</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.mariadb_server.username" title="Link to this definition">¶</a></dt>
  357. <dd><p>Username for the DB connection.</p>
  358. </dd></dl>
  359. <dl class="py data">
  360. <dt class="sig sig-object py" id="searx.engines.mariadb_server.password">
  361. <span class="sig-prename descclassname"><span class="pre">searx.engines.mariadb_server.</span></span><span class="sig-name descname"><span class="pre">password</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.mariadb_server.password" title="Link to this definition">¶</a></dt>
  362. <dd><p>Password for the DB connection.</p>
  363. </dd></dl>
  364. <dl class="py data">
  365. <dt class="sig sig-object py" id="searx.engines.mariadb_server.query_str">
  366. <span class="sig-prename descclassname"><span class="pre">searx.engines.mariadb_server.</span></span><span class="sig-name descname"><span class="pre">query_str</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">''</span></em><a class="headerlink" href="#searx.engines.mariadb_server.query_str" title="Link to this definition">¶</a></dt>
  367. <dd><p>SQL query that returns the result items.</p>
  368. </dd></dl>
  369. </section>
  370. </section>
  371. </section>
  372. <div class="clearer"></div>
  373. </div>
  374. </div>
  375. </div>
  376. <span id="sidebar-top"></span>
  377. <div class="sphinxsidebar" role="navigation" aria-label="Main">
  378. <div class="sphinxsidebarwrapper">
  379. <p class="logo"><a href="../../../index.html">
  380. <img class="logo" src="../../../_static/searxng-wordmark.svg" alt="Logo of SearXNG"/>
  381. </a></p>
  382. <h3><a href="../../../index.html">Table of Contents</a></h3>
  383. <ul class="current">
  384. <li class="toctree-l1"><a class="reference internal" href="../../../user/index.html">User information</a></li>
  385. <li class="toctree-l1"><a class="reference internal" href="../../../own-instance.html">Why use a private instance?</a></li>
  386. <li class="toctree-l1"><a class="reference internal" href="../../../admin/index.html">Administrator documentation</a></li>
  387. <li class="toctree-l1 current"><a class="reference internal" href="../../index.html">Developer documentation</a><ul class="current">
  388. <li class="toctree-l2"><a class="reference internal" href="../../quickstart.html">Development Quickstart</a></li>
  389. <li class="toctree-l2"><a class="reference internal" href="../../rtm_asdf.html">Runtime Management</a></li>
  390. <li class="toctree-l2"><a class="reference internal" href="../../contribution_guide.html">How to contribute</a></li>
  391. <li class="toctree-l2"><a class="reference internal" href="../../extended_types.html">Extended Types</a></li>
  392. <li class="toctree-l2 current"><a class="reference internal" href="../index.html">Engine Implementations</a><ul class="current">
  393. <li class="toctree-l3"><a class="reference internal" href="../enginelib.html">Engine Library</a></li>
  394. <li class="toctree-l3"><a class="reference internal" href="../engines.html">SearXNG’s engines loader</a></li>
  395. <li class="toctree-l3"><a class="reference internal" href="../engine_overview.html">Engine Overview</a></li>
  396. <li class="toctree-l3"><a class="reference internal" href="../index.html#resultlist-and-engines">ResultList and engines</a></li>
  397. <li class="toctree-l3 current"><a class="reference internal" href="../index.html#engine-types">Engine Types</a><ul class="current">
  398. <li class="toctree-l4"><a class="reference internal" href="../index.html#online-engines">Online Engines</a></li>
  399. <li class="toctree-l4 current"><a class="reference internal" href="../index.html#offline-engines">Offline Engines</a><ul class="current">
  400. <li class="toctree-l5"><a class="reference internal" href="../offline_concept.html">Offline Concept</a></li>
  401. <li class="toctree-l5"><a class="reference internal" href="../demo/demo_offline.html">Demo Offline Engine</a></li>
  402. <li class="toctree-l5"><a class="reference internal" href="command-line-engines.html">Command Line Engines</a></li>
  403. <li class="toctree-l5"><a class="reference internal" href="nosql-engines.html">NoSQL databases</a></li>
  404. <li class="toctree-l5"><a class="reference internal" href="search-indexer-engines.html">Local Search APIs</a></li>
  405. <li class="toctree-l5 current"><a class="current reference internal" href="#">SQL Engines</a></li>
  406. </ul>
  407. </li>
  408. <li class="toctree-l4"><a class="reference internal" href="../index.html#online-url-search">Online URL Search</a></li>
  409. <li class="toctree-l4"><a class="reference internal" href="../index.html#online-currency">Online Currency</a></li>
  410. <li class="toctree-l4"><a class="reference internal" href="../index.html#online-dictionary">Online Dictionary</a></li>
  411. </ul>
  412. </li>
  413. </ul>
  414. </li>
  415. <li class="toctree-l2"><a class="reference internal" href="../../result_types/index.html">Result Types</a></li>
  416. <li class="toctree-l2"><a class="reference internal" href="../../templates.html">Simple Theme Templates</a></li>
  417. <li class="toctree-l2"><a class="reference internal" href="../../search_api.html">Search API</a></li>
  418. <li class="toctree-l2"><a class="reference internal" href="../../plugins/index.html">Plugins</a></li>
  419. <li class="toctree-l2"><a class="reference internal" href="../../answerers/index.html">Answerers</a></li>
  420. <li class="toctree-l2"><a class="reference internal" href="../../translation.html">Translation</a></li>
  421. <li class="toctree-l2"><a class="reference internal" href="../../lxcdev.html">Developing in Linux Containers</a></li>
  422. <li class="toctree-l2"><a class="reference internal" href="../../makefile.html">Makefile &amp; <code class="docutils literal notranslate"><span class="pre">./manage</span></code></a></li>
  423. <li class="toctree-l2"><a class="reference internal" href="../../reST.html">reST primer</a></li>
  424. <li class="toctree-l2"><a class="reference internal" href="../../searxng_extra/index.html">Tooling box <code class="docutils literal notranslate"><span class="pre">searxng_extra</span></code></a></li>
  425. </ul>
  426. </li>
  427. <li class="toctree-l1"><a class="reference internal" href="../../../utils/index.html">DevOps tooling box</a></li>
  428. <li class="toctree-l1"><a class="reference internal" href="../../../src/index.html">Source-Code</a></li>
  429. </ul>
  430. <h3>Project Links</h3>
  431. <ul>
  432. <li><a href="https://github.com/searxng/searxng/tree/master">Source</a>
  433. <li><a href="https://github.com/searxng/searxng/wiki">Wiki</a>
  434. <li><a href="https://searx.space">Public instances</a>
  435. <li><a href="https://github.com/searxng/searxng/issues">Issue Tracker</a>
  436. </ul><h3>Navigation</h3>
  437. <ul>
  438. <li><a href="../../../index.html">Overview</a>
  439. <ul>
  440. <li><a href="../../index.html">Developer documentation</a>
  441. <ul>
  442. <li><a href="../index.html">Engine Implementations</a>
  443. <ul>
  444. <li>Previous: <a href="search-indexer-engines.html" title="previous chapter">Local Search APIs</a>
  445. <li>Next: <a href="../online_url_search/tineye.html" title="next chapter">Tineye</a></ul>
  446. </li></ul>
  447. </li>
  448. </ul>
  449. </li>
  450. </ul>
  451. <search id="searchbox" style="display: none" role="search">
  452. <h3 id="searchlabel">Quick search</h3>
  453. <div class="searchformwrapper">
  454. <form class="search" action="../../../search.html" method="get">
  455. <input type="text" name="q" aria-labelledby="searchlabel" autocomplete="off" autocorrect="off" autocapitalize="off" spellcheck="false"/>
  456. <input type="submit" value="Go" />
  457. </form>
  458. </div>
  459. </search>
  460. <script>document.getElementById('searchbox').style.display = "block"</script>
  461. <div role="note" aria-label="source link">
  462. <h3>This Page</h3>
  463. <ul class="this-page-menu">
  464. <li><a href="../../../_sources/dev/engines/offline/sql-engines.rst.txt"
  465. rel="nofollow">Show Source</a></li>
  466. </ul>
  467. </div>
  468. </div>
  469. </div>
  470. <div class="clearer"></div>
  471. </div>
  472. <div class="footer" role="contentinfo">
  473. &#169; Copyright SearXNG team.
  474. </div>
  475. </body>
  476. </html>