Error 500 clojure.lang.ExceptionInfo: Value does not match schema: (not (map? nil)) {:type :schema.core/error, :schema {:type Keyword, :field (cond-pre Keyword honeysql.types.SqlCall honeysql.types.SqlRaw {:select Any, Any Any}), Any Any}, :value nil, :error (not (map? nil))}

URI:	/pdb/query/v4
STATUS:	500
MESSAGE:	clojure.lang.ExceptionInfo: Value does not match schema: (not (map? nil)) {:type :schema.core/error, :schema {:type Keyword, :field (cond-pre Keyword honeysql.types.SqlCall honeysql.types.SqlRaw {:select Any, Any Any}), Any Any}, :value nil, :error (not (map? nil))}
SERVLET:	-
CAUSED BY:	clojure.lang.ExceptionInfo: Value does not match schema: (not (map? nil)) {:type :schema.core/error, :schema {:type Keyword, :field (cond-pre Keyword honeysql.types.SqlCall honeysql.types.SqlRaw {:select Any, Any Any}), Any Any}, :value nil, :error (not (map? nil))}

'\\n/home/travis/build/puppetlabs/puppetdb/vendor/bundle/ruby/2.5.0/bin/ruby_executable_hooks:24:in `eval'\\n/home/travis/build/puppetlabs/puppetdb/vendor/bundle/ruby/2.5.0/bin/ruby_executable_hooks:24:in `

'\\nWarning: Not using cache on failed catalog\\nError: Could not retrieve catalog; skipping run\\n\"}}\n at puppetlabs.puppetdb.integration.fixtures$bundle_exec.invokeStatic (fixtures.clj:243)\n puppetlabs.puppetdb.integration.fixtures$bundle_exec.doInvoke (fixtures.clj:235)\n clojure.lang.RestFn.applyTo (RestFn.java:139)\n clojure.core$apply.invokeStatic (core.clj:673)\n clojure.core$apply.doInvoke (core.clj:660)\n clojure.lang.RestFn.invoke (RestFn.java:2522)\n puppetlabs.puppetdb.integration.fixtures$run_puppet$fn__100061.invoke (fixtures.clj:270)\n puppetlabs.puppetdb.integration.fixtures$call_with_synchronized_command_processing.invokeStatic (fixtures.clj:130)\n puppetlabs.puppetdb.integration.fixtures$call_with_synchronized_command_processing.invoke (fixtures.clj:129)\n puppetlabs.puppetdb.integration.fixtures$run_puppet.invokeStatic (fixtures.clj:269)\n puppetlabs.puppetdb.integration.fixtures$run_puppet.invoke (fixtures.clj:248)\n puppetlabs.puppetdb.integration.fixtures$run_puppet.invokeStatic (fixtures.clj:250)\n puppetlabs.puppetdb.integration.fixtures$run_puppet.invoke (fixtures.clj:248)\n puppetlabs.puppetdb.integration.terminus_failover$fn__100672$fn__100681.invoke (terminus_failover.clj:21)\n puppetlabs.puppetdb.integration.terminus_failover$fn__100672.invokeStatic (terminus_failover.clj:19)\n puppetlabs.puppetdb.integration.terminus_failover/fn (terminus_failover.clj:7)\n clojure.test$test_var$fn__9737.invoke (test.clj:717)\n clojure.test$test_var.invokeStatic (test.clj:717)\n clojure.test$test_var.invoke (test.clj:708)\n clojure.test$test_vars$fn__9763$fn__9768.invoke (test.clj:735)\n clojure.test$default_fixture.invokeStatic (test.clj:687)\n clojure.test$default_fixture.invoke (test.clj:683)\n clojure.test$test_vars$fn__9763.invoke (test.clj:735)\n clojure.test$default_fixture.invokeStatic (test.clj:687)\n clojure.test$default_fixture.invoke (test.clj:683)\n clojure.test$test_vars.invokeStatic (test.clj:731)\n clojure.test$test_all_vars.invokeStatic (2020-10-21 23:18:39,740 WARN [async-dispatch-1] [o.e.j.s.AbstractConnector] Acceptors should be <= availableProcessors: ServerConnector@630ed324{HTTP/1.1, (http/1.1)}{0.0.0.0:0}\n{code}\n", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "53198", "fixedVersions": ["PDB n/a"], "id": "53198", "issueType": "CI Blocker", "key": "PDB-4940", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

PuppetDB collects data generated by Puppet. It enables advanced Puppet features like the inventory service and exported resources, and can be the foundation for other applications that use Puppet's data.

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "status": "In Progress", "statusCategory": "In Progress", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Add a default statement timeout to user queries", "timeSpent": "PT0S", "updated": "2023-03-08T13:32:00.000000", "votes": "1", "watchers": []}, {"affectedVersions": [], "assignee": "623c1489a1d81f0069d8e30a", "attachments": [], "comments": [{"author": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "body": "After a bit of investigation (and reading some of the chef-server discussion), I think I might lean toward just adding a new database config option like {{connection-username}} that when set, overrides the {{username}} that's specified when connecting (i.e. for the hikaricp connection pool), but doesn't affect other uses of the username (i.e. when we're issuing various sql commands that include a username).\n\nWhile I haven't thought it through yet, I suppose that might mean we'd actually need two options e.g. {{connection-username}} and {{connection-migrator-username}}.", "created": "2021-01-20T09:30:00.000000"}, {"author": "623c1489a1d81f0069d8e30a", "body": "[~accountid:70121:4c2994e4-73a9-4e99-971a-6d93d39be223],\u00a0[~accountid:557058:b0000c48-c6a4-41b8-baf9-6d9c091a181c]\n\nI managed to reproduce the exception using only PuppetDB and an Azure PostgreSQL\n\n{code}\nConnected to database as \"puppetdb\", not migrator \"puppetdb@ghost-db\"\n{code}\n\nThe exception is thrown by https://github.com/puppetlabs/puppetdb/blob/2cffbb9d898950c2883067cbbf7b7c5d3ba78064/src/puppetlabs/puppetdb/cli/services.clj#L593\nbecause the [current user|https://github.com/puppetlabs/puppetdb/blob/2cffbb9d898950c2883067cbbf7b7c5d3ba78064/src/puppetlabs/puppetdb/jdbc.clj#L675] is read from the database and does not contain `@domain`\n\nIn [PDB-4934|https://github.com/puppetlabs/puppetdb/pull/3406/files] I have trimmed `@domain` when doing the user name check and managed to write and read from Azure PostgreSQL.", "created": "2021-02-03T08:00:00.000000"}, {"author": "623c1489a1d81f0069d8e30a", "body": "[~accountid:70121:4c2994e4-73a9-4e99-971a-6d93d39be223] and [~accountid:557058:3915718f-2673-45b3-a0a6-c7c03ef0754e] suggested adding two new users: `{{connection-username}}\u00a0` and `connection-migrator-username`. The users will be used to establish new connections to the database (in the case of Azure, the pattern is `user@domain`). By implementing this we will make a clear distinction between the user that is used to connect to the database (in our case `connection-username` and `connection-migrator-username`) and the user that is used in queries (in our case `username` and `migrator-username`).\n\n\u00a0\n\nIf the `connection-migrator-username` is not specified in the database config, it will default to `migrator-username`, which in turn default to `username`.\n\n[https://github.com/puppetlabs/puppetdb/blob/6.x/src/puppetlabs/puppetdb/config.clj#L393-L399]\n\n\u00a0\n\nIf the `{{connection-username}}` is not specified in the database config, it will default to `{{username}}`.\n\n\u00a0\n\nExample of test:\u00a0[https://github.com/puppetlabs/puppetdb/commit/b489b38ff1484774ea08185db084f9670ee9fac4]", "created": "2021-02-04T04:16:00.000000"}], "components": ["PuppetDB"], "created": "2020-10-19T11:10:00.000000", "creator": "557058:b0000c48-c6a4-41b8-baf9-6d9c091a181c", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@29253afe"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|o05hb1:i"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Enhancement"}, {"fieldName": "Release Notes Summary", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textarea", "value": "Added two new users `connection-migrator-username` and `connection-username` in `database.ini` config file. The new users are used to establish connections to the database when the connection username is different from the database username (this is the case for managed PostgreSQL in Azure)\n\n"}, {"fieldName": "Story Points", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:float", "value": "13.0"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "20/Jan/21"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_8118969016_*|*_3_*:*_1_*:*_1868406151_*|*_10009_*:*_1_*:*_435098853_*|*_5_*:*_1_*:*_0"}], "description": "As a customer, I want to be able to\u00a0use Azure PostgreSQL as my external PostgreSQL database for Puppet Enterprise.\n \u00a0\n When attempting to use Azure PostgreSQL as an external database for PuppetDB (PE 2019.8.1), I encountered the problem that Azure requires the username for the Postgres connection to be in the\u00a0{{username@hostname}}\u00a0form, due to the way they publish access to PostgreSQL (as described\u00a0[here|https://github.com/chef/chef-server/issues/1559]). I can manually modify\u00a0{{database.ini}}\u00a0to set the username to that format, but then you\u2019ll see this in the logs:\n{noformat}clojure.lang.ExceptionInfo: Connected to database as \"pe-puppetdb-migrator\", not migrator \"pe-puppetdb-migrator@pdb01\"\n{noformat}\nIt seems we have the same limitations as Chef has (see linked issue).\n \u00a0\n This requirement from Azure stems from their architecture:\n{noformat}Azure Database for PostgreSQL has a gateway in front of the actual database servers that forwards connections from username@hostname to hostname as username.\nThis means that once the connection is established, you will actually be connected as username, not username@hostname, and any database queries involving users should just use username (e.g. granting permissions).\n{noformat}\n\u00a0\n Some issues I\u2019ve encountered while trying to get this to work:\n * The\u00a0[docs|https://puppet.com/docs/pe/2019.8/installing_postgresql.html#create_pe_databases_on_the_postgresql_instance]\u00a0don\u2019t tell you to also create a\u00a0{{pe-puppetdb-migrator}}\u00a0user\n * The [docs|https://puppet.com/docs/pe/2019.8/installing_postgresql.html#create_pe_databases_on_the_postgresql_instance] assume a Linux OS for the {{psql}} commands to create the users & databases. However, Azure PostgreSQL runs on Windows, which causes the locales to have different names. For Azure PostgreSQL, the {{ENCODING}} line needs to be changed to: {{ENCODING 'utf8' LC_CTYPE 'English_United States.1252' LC_COLLATE 'English_United States.1252' template template0;}}\n * You can\u2019t specify\u00a0{{username@hostname}}\u00a0for the\u00a0{{xxx_regular_db_user}}\u00a0and\u00a0{{xxx_migration_db_user}}\u00a0settings in\u00a0{{pe.conf}}, the\u00a0{{@hostname}}\u00a0part gets cutoff during installation.\n * I can manually re-add the\u00a0{{@hostname}}\u00a0back to the username in\u00a0{{database.ini}}\u00a0but then the queries also expect this for the connection, which they should not. And I can probably assume that another puppet run would overwrite the settings in\u00a0{{database.ini}}\u00a0again.", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "52707", "fixedVersions": ["PDB 6.15.0", "PDB 7.2.0"], "id": "52707", "issueType": "Bug", "key": "PDB-4934", "labels": ["tsr-pdb-backlog"], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:be86c7d6-2807-42d3-9715-80da0cf607cd", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "query with `in` operator fails", "timeSpent": "PT0S", "updated": "2022-02-10T08:29:00.000000", "votes": "1", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [{"author": "557058:1b9bde12-f0a1-4355-ab73-7fc4ec69ba79", "body": "Hi [~accountid:70121:cf7958f8-5b73-491f-8452-453de61bec39]. This looks like it might be a software issue rather than a documentation issue, so I'm moving this to the PDB project, where the PuppetDB team can have a look. Thank you!", "created": "2020-10-19T16:24:00.000000"}, {"author": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "body": "It looks like this might not be entirely related to PuppetDB, since we assume that the PostgreSQL trigram extensions are already available. On Debian derivatives, for example, that used to require installing something like postgresql-contrib-9.6, though now I believe it's included in say postgresql-11\n\nHowever, if you feel like we've misunderstood the situation, please feel free to re-open the ticket.\n", "created": "2021-02-10T11:14:00.000000"}], "components": ["PuppetDB"], "created": "2020-10-19T03:18:00.000000", "creator": "70121:cf7958f8-5b73-491f-8452-453de61bec39", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@4a2d8f24"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|o04kl4:"}, {"fieldName": "Scrum Team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "PuppetDB"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "19/Oct/20"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_9882032922_*|*_6_*:*_1_*:*_0"}], "description": "*Problem:*\n\n\u00a0Failed to install pg_trgm on centos 7, pgsql\u00a0\n\n\n\n\n\u00a0\n\n*Summary:*\n\n\u00a0 see here:\n[https://github.com/postgrespro/pg_trgm_pro/issues/4]\n\n\u00a0\n\n\u00a0", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "50094", "fixedVersions": [], "id": "50094", "issueType": "Bug", "key": "PDB-4935", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "70121:cf7958f8-5b73-491f-8452-453de61bec39", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "docs: postgresql config has issues", "timeSpent": "PT0S", "updated": "2022-03-03T06:29:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "attachments": [], "comments": [{"author": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "body": "A customer recently hit an issue where it appeared that PDB sync got stuck in similar way to what's described in this ticket. In the new case the problem presented differently, but we believe the difference is due to some of the mitigations which have been recently added to address long running PDB sync queries.\n\nIn the more recent case PDB was reloaded after some issues were seen with the service being intermittently unreachable. After the reload we noticed that the start up sync successfully completed but every subsequent periodic sync was reporting that it was unable to run with the following log message:\u00a0\n{code:java}[sync] Refusing to sync from ... Sync already in progress\n{code}\nThis was caused by the global [currently-syncing|https://github.com/puppetlabs/pe-puppetdb-extensions/blob/5fad454d1650c43243ab52308ce9f344186ca2fb/src/puppetlabs/pe_puppetdb_extensions/sync/services.clj#L49] atom being set to true and never getting reset because a periodic sync got stuck.\n\nWe were able to get a thread dump from PDB when it was in this state and confirmed some of our suspicions. It appears that the shutdown of the *at-at* threadpool we use to schedule tasks was still waiting to gracefully shutdown a periodic sync thread which got stuck at some point before the reload.\n\nEvidence of this can be seen in the thread dump [here|https://gist.github.com/Zak-Kent/0732597dc8f05c0904a8f990ea8f47d1]. *at-at* uses a future to shutdown and reset the thread pool we use to schedule sync. See [at-at stop-and-reset-pool! call|https://github.com/overtone/at-at/blob/master/src/overtone/at_at.clj#L267]. PDB calls this function when stopping the PDB TK sync service seen\u00a0[here|https://github.com/puppetlabs/pe-puppetdb-extensions/blob/5fad454d1650c43243ab52308ce9f344186ca2fb/src/puppetlabs/pe_puppetdb_extensions/sync/services.clj#L595]. Because this happens in a future in the *at-at* library it doesn't block and will wait until all threads running in the pool finish the job they're working on. When we look at the elapsed time of this thread (121 hrs) it roughly lines up with the reload of the PuppetDB service and when the thread dump was taken afterwards. Providing evidence that the *at-at* *stop-and-reset-pool!* call was stuck waiting on a thread in the pool to finish.\n\nWe also see evidence of a sync thread being stuck in the thread dump where it looks like a it's waiting to deref a promise in the *puppetlabs/clj-http-client*. The elapsed time of this thread (485 hrs) indicates that a periodic sync got stuck sometime before PDB was reloaded and was never cleared during the reload. Before a periodic sync being stuck like this would have caused issues with leaving a long running query held open, but due to the 2hr *statement_timeout* the customer had in place for the *pe-puppetdb* user *Postgres* was able to continue to function even though sync was stuck.\u00a0[stuck sync thread from dump.|https://gist.github.com/Zak-Kent/5e0289fdb70db7809a7dd417c3f037a2]\n\niiuc, when *TK* services get reloaded (*SIGHUP*) the signal gets intercepted and the stop/start method of the service and its *TK* deps get called but it doesn't fully shutdown the JVM. This could have caused the behaviour we noticed where the global *currently-syncing* atom was never reset due to the hung sync and *at-at* shutdown and as a result any periodic syncs after the reload reported that another sync was already in progress. The full start/stop (*SIGTERM*) of the PDB service corrected this issue because it forced the stuck threads to get shutdown and reset the state in the *currently-syncing* atom.\n\nWe're attempting to recreate a situation in which sync can get stuck in this way but haven't been able to yet. We believe it's due to the *clj-http-client* blocking on a promise during shutdown which doesn't get delivered. [See where clj-http-client derefs promise here|https://github.com/puppetlabs/clj-http-client/blob/ec78805007db944b0ef7b4e4212d4969d7d8d0a4/src/java/com/puppetlabs/http/client/impl/ExceptionInsertingPipedInputStream.java#L16] This deref is one of the last things in the call stack for the stuck sync thread linked above.\n\nIf we're unable to recreate the error case needed to trigger this issue we're considering using a different client for sync which doesn't have the same error handling as a way to work around/avoid this issue.\n\nI'll update the ticket as we find out more. In the meantime if sync stops running a full stop/start of the PuppetDB service should resolve any issues where sync has become wedged and avoid the issue where periodic sync thinks another sync in already in progress. \n \u00a0", "created": "2020-12-01T18:28:00.000000"}, {"author": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "body": "We're planning on adding additional logging and a way to capture stack traces from the sync thread automatically if we're unable to interrupt sync. This should allow us to better diagnose where sync can hang and rule out possible issues caused by the recent sync interruption changes. For now I'm moving this ticket into the suspended column but will link it to the ticket [~accountid:70121:4c2994e4-73a9-4e99-971a-6d93d39be223] is planning on making for the sync interrupt logging/stack trace capture work.", "created": "2020-12-07T17:42:00.000000"}, {"author": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "body": "Linked this ticket to PDB-4986, we will be using that ticket to cover the additional instrumentation stuff we're adding to help us diagnose this problem.\u00a0", "created": "2020-12-09T16:51:00.000000"}], "components": ["PuppetDB"], "created": "2020-10-15T16:35:00.000000", "creator": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@316b4614"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "Epic Link", "fieldType": "com.pyxis.greenhopper.jira:gh-epic-link", "value": "PDB-4969"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hykawv:00000ikoj002"}, {"fieldName": "Story Points", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:float", "value": "8.0"}, {"fieldName": "Zendesk Ticket Count", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:float", "value": "2.0"}, {"fieldName": "Zendesk Ticket IDs", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textarea", "value": "41188,42072"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_7655_*|*_3_*:*_1_*:*_546557401_*|*_5_*:*_1_*:*_0_*|*_10004_*:*_1_*:*_36442037469_*|*_10006_*:*_1_*:*_2753685930_*|*_10005_*:*_1_*:*_1286543510"}], "description": "There seems to be situations where PDB sync summary query transactions can remain open and PDB sync stops logging and hangs. When this happens sync will stop until PDB is restarted. It's also possible that running *SELECT pg_cancel_backend(pid);* on the query will restore sync, but this is less certain to work then a full PDB restart.\u00a0\n\nWe recently saw this issue when a PDB was in the middle of pulling reports from a replica and the replica was upgraded. [link to related slack msgs|https://puppet.slack.com/archives/CQSJANW2W/p1602714454099200]\n\nOrder of events:\n - primary started its report sync at: *2020-10-13T02:26:55.984Z*\n - replica received a shutdown signal at: *2020-10-13T02:27:23.876Z*\n - replica saw the errors in the following gist during shutdown: [shutdown-error-gist|https://gist.github.com/Zak-Kent/bf1d987ff9e15f25c156b4afc8ddeb78]\n\nAfter the replica was shutdown and upgraded the sync on the primary never logged again and there was an open sync summary query observed in *pg_stat_activity* which stayed open *idle in transaction* waiting on *ClientRead*.\n\nWe recently added a thread interrupter for sync in PDB-4909 but it seems like there are still edge cases that this work didn't cover. \n\nIt's possible that adding a statement_timeout to sync queries would help avoid this issue. \n\nWe'll work towards reproducing this error in the coming days will update the ticket with what we find. \n\u00a0", "epicLinkSummary": "Improve customer experience for puppetdb", "estimate": "PT0S", "externalId": "51168", "fixedVersions": [], "id": "51168", "issueType": "Bug", "key": "PDB-4932", "labels": ["jira_escalated"], "originalEstimate": "PT0S", "parent": "53204", "parentSummary": "Improve customer experience for puppetdb", "priority": "Major", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Update docs for report_ttl and resource_events_ttl", "timeSpent": "PT0S", "updated": "2022-03-03T06:29:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2020-09-16T10:37:00.000000", "creator": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@2175102c"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "Epic Link", "fieldType": "com.pyxis.greenhopper.jira:gh-epic-link", "value": "PDB-4894"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hykawv:00000iy601ii00u"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_9616274021_*|*_5_*:*_1_*:*_0"}], "description": "We are implementing optimizations for storage and HA sync for catalog inputs, so we should perf test the resulting product to ensure that we in fact made it faster, and get a rough quantification of _how much faster_ we made it in the process.", "epicLinkSummary": "Enable large customers (10k+ nodes) to be able to use Impact Analysis", "estimate": "PT0S", "externalId": "49067", "fixedVersions": [], "id": "49067", "issueType": "Task", "key": "PDB-4898", "labels": [], "originalEstimate": "PT0S", "parent": "52197", "parentSummary": "Enable large customers (10k+ nodes) to be able to use Impact Analysis", "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:2249d8e6-5f8c-489f-942b-1c2739792d34", "resolution": "Duplicate", "resolutionDate": "2020-11-03T18:08:00.000000", "status": "Closed", "statusCategory": "Done", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Prefer JSON fact terminus for fact cache to YAML", "timeSpent": "PT0S", "updated": "2022-01-17T12:34:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "attachments": [], "comments": [{"author": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "body": "Hello [~accountid:557058:77e61db9-5988-47b2-a5fb-b2bf857ff07c],\n\nThere was a cve linked in the PuppetDB 5.2.13 release notes which caused PuppetDB to disable the *metrics/v1* endpoint by default. [PuppetDB 5.2.13 release notes|https://puppet.com/docs/puppetdb/5.2/release_notes.html#puppetdb-5213] & [CVE-2020-7943|https://puppet.com/security/cve/CVE-2020-7943/]\n\nAll uses of *metrics/v1* can be replaced by a call to *metrics/v2/read* over localhost. Here are some docs for how things work in the *metrics/v2/read* endpoint: [jolokia docs|https://jolokia.org/reference/html/protocol.html#read] .\n\nYou'll need to replace *GET /metrics/v1/mbeans/* with *GET /metrics/v2/read/*. The response you get back will have a slightly different structure but contain the same information. The data that used to be returned from the *v1* endpoint is now nested under a *value* key in the *v2* version of the response.\n\nLooking into this I also noticed the PuppetDB docs for the metrics endpoint haven't been updated properly. We'll work on updating the docs now, sorry for the confusion. Hope that helps", "created": "2020-09-03T12:03:00.000000"}, {"author": "557058:77e61db9-5988-47b2-a5fb-b2bf857ff07c", "body": "Hi [~accountid:557058:3915718f-2673-45b3-a0a6-c7c03ef0754e] !\n\nThanks for this response. That explains it all. :)\n\nA manual test confirms what you wrote:\n{noformat}\nhttp://localhost:8080/metrics/v2/read/puppetlabs.puppetdb.population:name=pct-resource-dupesrequest\t\n\nmbean\t\"puppetlabs.puppetdb.population:name=pct-resource-dupes\"\ntype\t\"read\"\nvalue\t\nValue\t\"151107/183659\"\ntimestamp\t1599214647\nstatus\t200{noformat}\nThe v2 metrics endpoint is working fine.\n\n\u00a0\n\nYes, updating the docs would help others in the same situation like me. Nowhere did I see any mention of v1 being disabled.\n\nFor completeness in this ticket (and possibly also in your updated documentation), can you please add instructions on how to force the v1 endpoint back on?", "created": "2020-09-04T04:31:00.000000"}, {"author": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "body": "Hi [~accountid:557058:77e61db9-5988-47b2-a5fb-b2bf857ff07c],\u00a0\n\nI was able to turn the v1 endpoint back on by creating a *metrics.conf*\u00a0file in the\u00a0*/etc/puppetlabs/puppetdb/conf.d/* directory with the following contents.\u00a0\n{code:java}metrics: {\n metrics-webservice: {\n mbeans: {\n enabled: true\n }\n }\n}\n{code}\nI did this in a Puppet Enterprise install so the location of your *conf.d*\u00a0directory for *PuppetDB* might be slightly different. After this file is in place restarting the *PuppetDB* service should enable the *v1* metrics. I was able to check this by hitting the [http://127.0.0.1:8080/metrics/v1/mbeans]\u00a0endpoint which lists all available metrics.\u00a0Hope that helps!\n\n\u00a0\n\nWe will be updating our docs to reflect this, thanks for raising the ticket!", "created": "2020-09-08T14:27:00.000000"}, {"author": "557058:77e61db9-5988-47b2-a5fb-b2bf857ff07c", "body": "Thanks for your excellent answers!\n\n\u00a0\n\nFor completeness, I plan to test the above metrics.conf file in an open source Puppet, tomorrow or next week.", "created": "2020-09-09T15:53:00.000000"}, {"author": "557058:77e61db9-5988-47b2-a5fb-b2bf857ff07c", "body": "Confirmed in the open-source version (in this case, puppetdb 5.2.15-1stretch). :)\n{noformat}\n#grep ^CONFIG /etc/default/puppetdb\nCONFIG=\"/etc/puppetlabs/puppetdb/conf.d\"\n\nI created the metrics.conf file above in this dir and ran 'systemctl restart puppetdb'.\n\nNow the v1 endpoint respond to queries again.{noformat}\n\u00a0", "created": "2020-09-14T03:06:00.000000"}, {"author": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "body": "(y)\u00a0great, thank you for testing that!", "created": "2020-09-14T10:38:00.000000"}], "components": ["PuppetDB"], "created": "2020-09-02T07:33:00.000000", "creator": "557058:77e61db9-5988-47b2-a5fb-b2bf857ff07c", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Acceptance Criteria", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textarea", "value": "Metrics endpoint replies with \"200 OK\" and correct data and not just \"404 not found\"."}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@2504323b"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "Epic Link", "fieldType": "com.pyxis.greenhopper.jira:gh-epic-link", "value": "PDB-4759"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Customer Feedback"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|o03vrk:"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "03/Sep/20"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_543323993_*|*_3_*:*_1_*:*_86804343_*|*_10009_*:*_1_*:*_5880547870_*|*_5_*:*_1_*:*_0_*|*_10006_*:*_1_*:*_973619"}], "description": "Strange bug:\n\n\u00a0\n\nAfter I upgraded puppetdb from 5.2.12-1stretch to 5.2.15-1stretch, I can no longer access the metrics endpoint.\n\nAll requests to /metrics/v1/mbeans/* get at \"404 not found\" response while requests to e.g. /pdb/query/v4/ work just fine (200 OK).\n\n\u00a0\n\nPrior to Jun 30, my system (Debian 9) was running puppetdb\u00a05.2.12-1stretch and everything was working fine.\n On Jun 30, an 'apt-get upgrade' upgraded puppet-agent, puppet5-release, puppetdb,\u00a0puppetserver and puppetdb-termini:\n{noformat}dpkg.log.3.gz:2020-06-30 08:34:48 upgrade puppet-agent:amd64 5.5.18-1stretch 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:48 status half-configured puppet-agent:amd64 5.5.18-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:48 status unpacked puppet-agent:amd64 5.5.18-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:48 status half-installed puppet-agent:amd64 5.5.18-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:50 status half-installed puppet-agent:amd64 5.5.18-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 configure puppet-agent:amd64 5.5.20-1stretch \ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status unpacked puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status half-configured puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:34:51 status installed puppet-agent:amd64 5.5.20-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 upgrade puppet5-release:all 5.0.0-7stretch 5.0.0-11stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status half-configured puppet5-release:all 5.0.0-7stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status unpacked puppet5-release:all 5.0.0-7stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status half-installed puppet5-release:all 5.0.0-7stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status half-installed puppet5-release:all 5.0.0-7stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status unpacked puppet5-release:all 5.0.0-11stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status unpacked puppet5-release:all 5.0.0-11stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 upgrade puppetdb:all 5.2.12-1stretch 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status half-configured puppetdb:all 5.2.12-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status unpacked puppetdb:all 5.2.12-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status half-installed puppetdb:all 5.2.12-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status half-installed puppetdb:all 5.2.12-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status unpacked puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status unpacked puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 upgrade puppetserver:all 5.3.11-1stretch 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status half-configured puppetserver:all 5.3.11-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status unpacked puppetserver:all 5.3.11-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:33 status half-installed puppetserver:all 5.3.11-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:34 status half-installed puppetserver:all 5.3.11-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:34 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:34 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:34 upgrade puppetdb-termini:all 5.2.12-1stretch 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:34 status half-configured puppetdb-termini:all 5.2.12-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:34 status unpacked puppetdb-termini:all 5.2.12-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:34 status half-installed puppetdb-termini:all 5.2.12-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:34 status half-installed puppetdb-termini:all 5.2.12-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:34 status unpacked puppetdb-termini:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:34 status unpacked puppetdb-termini:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:40 configure puppetdb:all 5.2.15-1stretch \ndpkg.log.3.gz:2020-06-30 08:36:40 status unpacked puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:40 status unpacked puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:40 status unpacked puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:40 status unpacked puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:40 status unpacked puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:40 status unpacked puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:40 status unpacked puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:40 status unpacked puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:40 status unpacked puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:40 status unpacked puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:36:40 status half-configured puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:20 status installed puppetdb:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:20 configure puppetdb-termini:all 5.2.15-1stretch \ndpkg.log.3.gz:2020-06-30 08:37:20 status unpacked puppetdb-termini:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:20 status half-configured puppetdb-termini:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:20 status installed puppetdb-termini:all 5.2.15-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 configure puppetserver:all 5.3.13-1stretch \ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status unpacked puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:21 status half-configured puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:51 status installed puppetserver:all 5.3.13-1stretch\ndpkg.log.3.gz:2020-06-30 08:37:51 configure puppet5-release:all 5.0.0-11stretch \ndpkg.log.3.gz:2020-06-30 08:37:51 status unpacked puppet5-release:all 5.0.0-11stretch\ndpkg.log.3.gz:2020-06-30 08:37:51 status unpacked puppet5-release:all 5.0.0-11stretch\ndpkg.log.3.gz:2020-06-30 08:37:51 status unpacked puppet5-release:all 5.0.0-11stretch\ndpkg.log.3.gz:2020-06-30 08:37:51 status half-configured puppet5-release:all 5.0.0-11stretch\ndpkg.log.3.gz:2020-06-30 08:37:51 status installed puppet5-release:all 5.0.0-11stretch {noformat}\nThe machine is now running puppetdb v5.2.15. Now the metrics endpoint stopped working.\n\nHere I have grep:ed a request for the metric \"pct-resource-dupes\" before and after:\n{noformat}puppetdb-access-2020-06-29.0.log.gz:127.0.0.1 - - [29/Jun/2020:17:24:14 +0200] \"GET /metrics/v1/mbeans/puppetlabs.puppetdb.population:name=pct-resource-dupes HTTP/1.1\" 200 28 \"https://puppet-explorer.foo.bar.se/\" \"Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:77.0) Gecko/20100101 Firefox/77.0\" 2\npuppetdb-access-2020-06-30.0.log.gz:127.0.0.1 - - [30/Jun/2020:12:56:10 +0200] \"GET /metrics/v1/mbeans/puppetlabs.puppetdb.population:name=pct-resource-dupes HTTP/1.1\" 404 304 \"https://puppet-explorer.foo.bar.se/\" \"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36\" 4 {noformat}\nOn the 29th I got a '200' response while since the 30th I only get '404':s.\n\nI can't find any configuration to explain why it stopped working.\n I can't find any logs to explain why it stopped working.\n\nThe only change I know I had to do after the upgrade: \n In the puppet-agent 5.5.20 version, there was a big change (a bugfix) as to how puppet uses the http_proxy ENV variables as well as the no_proxy configuration.\n I don't see how a change in my proxy settings would break only the metrics endpoint and nothing else.\n\nPlease let me know if you need more details.\n\n\u00a0\n{noformat}\nA tcpdump on the loopback interface:\n12:48:21.691571 IP 127.0.0.1.57864 > 127.0.0.1.8080: Flags [P.], seq 627:1245, ack 487, win 350, options [nop,nop,TS val 83538331 ecr 83538329], length 618: HTTP: GET /metrics/v1/mbeans/puppetlabs.puppetdb.p\n 0x0000: 4500 029e 72d8 4000 4006 c77f 7f00 0001 E...r.@.@.......\n 0x0010: 7f00 0001 e208 1f90 208a f1e4 0441 4e10 .............AN.\n 0x0020: 8018 015e 0093 0000 0101 080a 04fa b19b ...^............\n 0x0030: 04fa b199 4745 5420 2f6d 6574 7269 6373 ....GET./metrics\n 0x0040: 2f76 312f 6d62 6561 6e73 2f70 7570 7065 /v1/mbeans/puppe\n 0x0050: 746c 6162 732e 7075 7070 6574 6462 2e70 tlabs.puppetdb.p\n 0x0060: 6f70 756c 6174 696f 6e3a 6e61 6d65 3d6e opulation:name=n\n 0x0070: 756d 2d72 6573 6f75 7263 6573 2048 5454 um-resources.HTT\n 0x0080: 502f 312e 310d 0a48 6f73 743a 206c 6f63 P/1.1..Host:.loc\n 0x0090: 616c 686f 7374 3a38 3038 300d 0a55 7365 alhost:8080..Use\n 0x00a0: 722d 4167 656e 743a 204d 6f7a 696c 6c61 r-Agent:.Mozilla\n 0x00b0: 2f35 2e30 2028 5769 6e64 6f77 7320 4e54 /5.0.(Windows.NT\n 0x00c0: 2036 2e31 3b20 5769 6e36 343b 2078 3634 .6.1;.Win64;.x64\n 0x00d0: 3b20 7276 3a38 302e 3029 2047 6563 6b6f ;.rv:80.0).Gecko\n 0x00e0: 2f32 3031 3030 3130 3120 4669 7265 666f /20100101.Firefo\n 0x00f0: 782f 3830 2e30 0d0a 4163 6365 7074 3a20 x/80.0..Accept:.\n 0x0100: 6170 706c 6963 6174 696f 6e2f 6a73 6f6e application/json\n 0x0110: 2c20 7465 7874 2f70 6c61 696e 2c20 2a2f ,.text/plain,.*/\n 0x0120: 2a0d 0a41 6363 6570 742d 4c61 6e67 7561 *..Accept-Langua\n 0x0130: 6765 3a20 656e 2d47 422c 656e 3b71 3d30 ge:.en-GB,en;q=0\n 0x0140: 2e38 2c65 6e2d 5553 3b71 3d30 2e36 2c73 .8,en-US;q=0.6,s\n 0x0150: 762d 5345 3b71 3d30 2e34 2c73 763b 713d v-SE;q=0.4,sv;q=\n 0x0160: 302e 320d 0a41 6363 6570 742d 456e 636f 0.2..Accept-Enco\n 0x0170: 6469 6e67 3a20 677a 6970 2c20 6465 666c ding:.gzip,.defl\n 0x0180: 6174 652c 2062 720d 0a52 6566 6572 6572 ate,.br..Referer\n 0x0190: 3a20 6874 7470 733a 2f2f 7075 7070 6574 :.https://puppet\n 0x01a0: 2d65 7870 6c6f 7265 722e 7075 7070 6574 -explorer.......\n .....\n12:48:21.691869 IP 127.0.0.1.8080 > 127.0.0.1.57864: Flags [P.], seq 487:964, ack 1245, win 361, options [nop,nop,TS val 83538331 ecr 83538331], length 477: HTTP: HTTP/1.1 404 Not Found\n 0x0000: 4500 0211 1db7 4000 4006 1d2e 7f00 0001 E.....@.@.......\n 0x0010: 7f00 0001 1f90 e208 0441 4e10 208a f44e .........AN....N\n 0x0020: 8018 0169 0006 0000 0101 080a 04fa b19b ...i............\n 0x0030: 04fa b19b 4854 5450 2f31 2e31 2034 3034 ....HTTP/1.1.404\n 0x0040: 204e 6f74 2046 6f75 6e64 0d0a 4461 7465 .Not.Found......\n .....\n{noformat}", "environment": "Debian 9\n\npuppet-agent 5.5.20-1stretch amd64\npuppet5-release 5.0.0-11stretch all\npuppetdb 5.2.15-1stretch all\npuppetdb-termini 5.2.15-1stretch all\npuppetexplorer 2.0.0-62 all\npuppetserver 5.3.13-1stretch all\nruby-puppet-forge 2.2.2-2 all\nruby-semantic-puppet 0.1.4-2 all", "epicLinkSummary": "Improvements to PuppetDB's Documentation", "estimate": "PT0S", "externalId": "48534", "fixedVersions": [], "id": "48534", "issueType": "Bug", "key": "PDB-4876", "labels": ["docs", "metrics"], "originalEstimate": "PT0S", "parent": "50600", "parentSummary": "Improvements to PuppetDB's Documentation", "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Add option to log PDBQuery correlation uuids in Postgres ", "timeSpent": "PT0S", "updated": "2022-05-13T09:14:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [{"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "[~accountid:623cff48b75ca80070575e17] are you able to provide an explain analyze of the query from the 5.1.5 postgres, or is that gone at this point?\n", "created": "2020-08-27T10:09:00.000000"}, {"author": "623cff48b75ca80070575e17", "body": "Yes we have rolled back the update to the old version.\n\nWhat is interesting is that the query in 5.1 database returns a result while the query in the 6.11 version does not. The set of data should be the same, the same hosts have run against the databases.\n\nThe analyze of the same query in the old database:\n\n{code}\n Nested Loop Left Join (cost=750.28..3002.76 rows=1 width=1363) (actual time=15.440..73.436 rows=8 loops=1)\n -> Nested Loop Left Join (cost=749.85..2994.32 rows=1 width=645) (actual time=15.421..73.357 rows=8 loops=1)\n -> Nested Loop Semi Join (cost=749.71..2994.15 rows=1 width=615) (actual time=15.403..73.323 rows=8 loops=1)\n -> Hash Join (cost=749.15..1586.53 rows=4 width=615) (actual time=4.170..21.330 rows=3846 loops=1)\n Hash Cond: (certnames.certname = c.certname)\n -> Nested Loop (cost=0.56..837.86 rows=9 width=607) (actual time=0.034..15.100 rows=3947 loops=1)\n -> Index Scan using catalog_resources_exported_idx on catalog_resources resources (cost=0.28..763.18 rows=9 width=589) (actual time=0.020..6.019 rows=3947 loops=1)\n Filter: (type = 'Prometheus::Scrape_job'::text)\n -> Index Scan using certnames_transform_pkey on certnames (cost=0.28..8.30 rows=1 width=34) (actual time=0.002..0.002 rows=1 loops=3947)\n Index Cond: (id = resources.certname_id)\n -> Hash (cost=731.62..731.62 rows=1358 width=34) (actual time=4.120..4.120 rows=2659 loops=1)\n Buckets: 4096 (originally 2048) Batches: 1 (originally 1) Memory Usage: 214kB\n -> Seq Scan on catalogs c (cost=391.88..731.62 rows=1358 width=34) (actual time=1.121..3.160 rows=2659 loops=1)\n Filter: ((certname <> 'mprom003.server.lan'::text) AND (NOT (hashed SubPlan 1)))\n Rows Removed by Filter: 57\n SubPlan 1\n -> Seq Scan on certnames certnames_1 (cost=0.00..391.71 rows=68 width=26) (actual time=0.012..1.081 rows=61 loops=1)\n Filter: ((deactivated IS NOT NULL) OR (expired IS NOT NULL))\n Rows Removed by Filter: 2662\n -> Index Scan using resource_params_hash_expr_idx on resource_params (cost=0.56..281.64 rows=1 width=21) (actual time=0.013..0.013 rows=0 loops=3846)\n Index Cond: (encode(resource, 'hex'::text) = encode(resources.resource, 'hex'::text))\n Filter: ((name = 'job_name'::text) AND (value = '\"jobname\"'::text))\n Rows Removed by Filter: 3\n -> Index Scan using environments_pkey on environments e (cost=0.14..0.16 rows=1 width=46) (actual time=0.003..0.003 rows=1 loops=8)\n Index Cond: (id = c.environment_id)\n -> Index Scan using resource_params_cache_pkey on resource_params_cache rpc (cost=0.42..8.44 rows=1 width=728) (actual time=0.008..0.008 rows=1 loops=8)\n Index Cond: (resource = resources.resource)\n Planning Time: 2.213 ms\n Execution Time: 73.535 ms\n{code}", "created": "2020-08-28T01:17:00.000000"}, {"author": "623cff48b75ca80070575e17", "body": "We have verified that two queries that return the same result in both databases show the different performance characteristics and have the same analyze results. So the statement above that the slow query returned no result is probably unrelated to the issue.", "created": "2020-08-28T02:46:00.000000"}, {"author": "623cff48b75ca80070575e17", "body": "Setting\n{code:java}\nSET enable_nestloop = off", "created": "2020-08-28T05:19:00.000000"}, {"author": "623cff48b75ca80070575e17", "body": "Running\n{code}\nCREATE STATISTICS resource_params_statistics (dependencies) ON name, value FROM resource_params", "created": "2020-08-28T05:51:00.000000"}, {"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "Thanks for the info [~accountid:623cff48b75ca80070575e17], glad to hear you were able to get it figured out. I'll leave this ticket open so that we'll take a look at PuppetDB and postgres 12 to make sure we didn't miss any changes that would cause that table's stats to be out of date. If you run into any more issues like this, it could help to set up {{pg_repack}} to periodically repack the affected tables (https://reorg.github.io/pg_repack/).", "created": "2020-08-28T10:36:00.000000"}, {"author": "623cff48b75ca80070575e17", "body": "It appears the performance of the query regresses after some time again and we have to manually call the ANALYZE again.\n\nCan this query be improved to be less fragile on the statistics of the table? A two nested subqueries on such large tables seems to be quite problematic.\n\nThough it is probably also worth a postgres bugreport. It is odd that it attempts a double index scan despite the estimation being that one of the indices only returns 40 rows and the other 5000 rows.", "created": "2020-09-10T07:18:00.000000"}, {"author": "623cff48b75ca80070575e17", "body": "As the issue keeps reoccuring we have performed some more tests on the query running following before each query:\nVACUUM ANALYZE resource_params", "created": "2020-10-14T02:43:00.000000"}], "components": ["PuppetDB"], "created": "2020-08-27T08:12:00.000000", "creator": "623cff48b75ca80070575e17", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@5796a9da"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hyk7db:630i96hy"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "27/Aug/20"}], "description": "Hi,\n\nWe have tried updating an environment with a few thousand hosts and 4441439 entries in the catalog_resources postgres table from puppetdb 5.1.5 to 6.11.3 and have seen a large regression in the resource query performance\n\nA query like\n{code}\n/pdb/query/v4/resources?query=[\"and\",[\"=\",\"type\",\"Prometheus::Scrape_job\"],[\"=\",\"exported\",true],[\"not\",[\"=\",\"certname\",\"mprom003.server.lan\"]],[\"=\",[\"parameter\",\"job_name\"],\"jobname\"]]\n {code}\n\nwhich used to take 70ms now takes 4 seconds.\nThe query is generated by prometheus scrape config:\nhttps://github.com/voxpupuli/puppet-prometheus/blob/3ae9b926c8697938398ff2ff66c2dcda539a6603/manifests/config.pp#L234\n\nand is executed many times and now times out due to the slow query.\n\nSlow query log:\n{code}\nSELECT: ... duration: 4027.270 ms execute /C_3: WITH inactive_nodes AS (SELECT certname FROM certnames WHERE (deactivated IS NOT NULL AND deactivated > '2020-08-13T13:23:03.928Z') OR (expired IS NOT NULL and expired > '2020-08-13T13:23:03.928Z')), not_active_nodes AS (SELECT certname FROM certnames WHERE (deactivated IS NOT NULL OR expired IS NOT NULL)) SELECT encode(resources.resource::bytea, 'hex') AS resource, c.certname AS certname, tags AS tags, exported AS exported, line AS line, title AS title, type AS type, e.environment AS environment, file AS file, rpc.parameters AS parameters FROM catalog_resources resources INNER JOIN certnames ON resources.certname_id = certnames.id INNER JOIN catalogs c ON c.certname = certnames.certname LEFT JOIN environments e ON c.environment_id = e.id LEFT JOIN resource_params_cache rpc ON rpc.resource = resources.resource WHERE (((type = $1) AND (exported = $2) AND NOT (c.certname = $3) AND ((encode(resources.resource::bytea, 'hex')) in (SELECT res_param_resource FROM ( (SELECT encode(resource::bytea, 'hex') AS res_param_resource FROM resource_params WHERE ((name = $4) AND (value = $5))) ) sub))) AND NOT ((c.certname) in (SELECT certname FROM ( (SELECT not_active_nodes.certname AS certname FROM not_active_nodes) ) sub)))\nparameters: $1 = 'Prometheus::Scrape_job', $2 = 't', $3 = 'mprom003.server.lan', $4 = 'job_name', $5 = '\"jobname\"'\n{code}\n\nHere the explain of the slow query:\n{code}\n Nested Loop Left Join (cost=591.68..1122.65 rows=1 width=1357) (actual time=4098.976..4098.976 rows=0 loops=1)\n -> Nested Loop Left Join (cost=591.26..1114.20 rows=1 width=636) (actual time=4098.976..4098.976 rows=0 loops=1)\n -> Nested Loop Semi Join (cost=591.10..1113.99 rows=1 width=612) (actual time=4098.975..4098.975 rows=0 loops=1)\n -> Hash Join (cost=453.88..690.22 rows=3 width=612) (actual time=62.459..70.658 rows=3810 loops=1)\n Hash Cond: (c.certname = certnames.certname)\n -> Seq Scan on catalogs c (cost=62.27..293.66 rows=1312 width=34) (actual time=0.933..4.710 rows=2625 loops=1)\n Filter: ((certname <> 'mprom003.server.lan'::text) AND (NOT (hashed SubPlan 1)))\n Rows Removed by Filter: 1\n SubPlan 1\n -> Seq Scan on certnames certnames_1 (cost=0.00..62.27 rows=1 width=26) (actual time=0.896..0.896 rows=0 loops=1)\n Filter: ((deactivated IS NOT NULL) OR (expired IS NOT NULL))\n Rows Removed by Filter: 2627\n -> Hash (cost=391.53..391.53 rows=6 width=604) (actual time=61.494..61.494 rows=3811 loops=1)\n Buckets: 4096 (originally 1024) Batches: 1 (originally 1) Memory Usage: 2182kB\n -> Nested Loop (cost=318.02..391.53 rows=6 width=604) (actual time=4.377..56.959 rows=3811 loops=1)\n -> Bitmap Heap Scan on catalog_resources resources (cost=317.74..341.74 rows=6 width=586) (actual time=4.367..46.896 rows=3811 loops=1)\n Recheck Cond: (exported AND (type = 'Prometheus::Scrape_job'::text))\n Heap Blocks: exact=3801\n -> BitmapAnd (cost=317.74..317.74 rows=6 width=0) (actual time=3.755..3.755 rows=0 loops=1)\n -> Bitmap Index Scan on catalog_resources_exported_idx (cost=0.00..80.54 rows=3263 width=0) (actual time=1.306..1.306 rows=3840 loops=1)\n -> Bitmap Index Scan on catalog_resources_type_idx (cost=0.00..236.95 rows=8602 width=0) (actual time=2.222..2.222 rows=7947 loops=1)\n Index Cond: (type = 'Prometheus::Scrape_job'::text)\n -> Index Scan using certnames_transform_pkey on certnames (cost=0.28..8.30 rows=1 width=34) (actual time=0.002..0.002 rows=1 loops=3811)\n Index Cond: (id = resources.certname_id)\n -> Bitmap Heap Scan on resource_params (cost=137.23..141.25 rows=1 width=21) (actual time=1.056..1.056 rows=0 loops=3810)\n Recheck Cond: ((encode(resource, 'hex'::text) = encode(resources.resource, 'hex'::text)) AND (name = 'job_name'::text))\n Filter: (value = 'jobname'::text)\n Rows Removed by Filter: 1\n Heap Blocks: exact=3810\n -> BitmapAnd (cost=137.23..137.23 rows=1 width=0) (actual time=1.046..1.046 rows=0 loops=3810)\n -> Bitmap Index Scan on resource_params_hash_expr_idx (cost=0.00..4.86 rows=40 width=0) (actual time=0.021..0.021 rows=3 loops=3810)\n Index Cond: (encode(resource, 'hex'::text) = encode(resources.resource, 'hex'::text))\n -> Bitmap Index Scan on idx_resources_params_name (cost=0.00..132.12 rows=5291 width=0) (actual time=0.988..0.988 rows=7479 loops=3810)\n Index Cond: (name = 'job_name'::text)\n -> Index Scan using environments_pkey on environments e (cost=0.15..0.21 rows=1 width=40) (never executed)\n Index Cond: (id = c.environment_id)\n -> Index Scan using resource_params_cache_pkey on resource_params_cache rpc (cost=0.42..8.44 rows=1 width=731) (never executed)\n Index Cond: (resource = resources.resource)\n Planning Time: 6.063 ms\n Execution Time: 4099.327 ms\n(40 rows)\n{code}\n\nThe database has been freshly initialized from scratch, no migration was performed.\nThe database is a postgres 12", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "49680", "fixedVersions": [], "id": "49680", "issueType": "Bug", "key": "PDB-4874", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "623cff48b75ca80070575e17", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "regression on resource query performance on upgrade to 6.11.3 from 5.1", "timeSpent": "PT0S", "updated": "2022-02-10T07:51:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "attachments": [], "comments": [{"author": "5b64ddd7d1e8dc2d916c6289", "body": "Things in the modules that will need changes when this is implemented (double check I didn't miss any, though):\n* https://github.com/puppetlabs/puppet-enterprise-modules/blob/master/modules/puppet_enterprise/manifests/puppetdb/database_ini.pp#L112\n* https://github.com/puppetlabs/puppet-enterprise-modules/blob/master/modules/puppet_enterprise/manifests/puppetdb/database_ini.pp#L117\n* https://github.com/puppetlabs/puppet-enterprise-modules/blob/d63b11863f7c3b016e0c78cb5709cc5c841da042/modules/puppet_enterprise/manifests/profile/puppetdb.pp#L82\n* https://github.com/puppetlabs/puppet-enterprise-modules/blob/07a1ba6d5bd88c39fd4c3e8700737ac57c372eff/modules/puppet_enterprise/manifests/puppetdb/jetty_ini.pp#L130\n* https://github.com/puppetlabs/puppet-enterprise-modules/blob/master/modules/puppet_enterprise/manifests/certs/puppetdb_allowlist.pp#L24\n* https://github.com/puppetlabs/puppet-enterprise-modules/blob/95ea12b667dc2732735d612d5e26962953e266ac/modules/pe_manager/lib/puppet_x/util/ha.rb#L108", "created": "2020-09-14T12:32:00.000000"}, {"author": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "body": "Thanks [~accountid:5b64ddd7d1e8dc2d916c6289],\u00a0\n\nWe need to expose another setting in p-e-m we added recently, so I can make the harmful language switch at the same time. Should get a PR up tomorrow or Wednesday.", "created": "2020-09-14T14:12:00.000000"}], "components": ["PuppetDB"], "created": "2020-08-26T11:41:00.000000", "creator": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@1643ff22"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hykawv:00000iko"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Enhancement"}, {"fieldName": "Release Notes Summary", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textarea", "value": "The `certificate-whitelist` and `facts-blacklist` configuration options have been deprecated in favor of `certificate-allowlist` and `facts-blocklist`. See also: https://puppet.com/blog/removing-harmful-terminology-from-our-products/"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "14/Sep/20"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "10008_*:*_1_*:*_3291599799_*|*_1_*:*_1_*:*_1457696_*|*_10007_*:*_1_*:*_1017740128_*|*_3_*:*_1_*:*_448835448_*|*_10009_*:*_1_*:*_597272924_*|*_5_*:*_1_*:*_0_*|*_10006_*:*_1_*:*_177386393"}], "epicLinkSummary": null, "estimate": "PT0S", "externalId": "49033", "fixedVersions": ["PDB 6.13.0"], "id": "49033", "issueType": "Improvement", "key": "PDB-4872", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:87794f03-5ebb-463b-a83b-14e61f55aa9c", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "DOCS: Incorrect command in connect_puppet_master", "timeSpent": "PT0S", "updated": "2022-03-03T06:29:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2020-07-31T17:04:00.000000", "creator": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@76c8d041"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|o03dyw:"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_33476_*|*_3_*:*_1_*:*_242721274_*|*_10009_*:*_1_*:*_1397892710_*|*_5_*:*_1_*:*_0"}], "epicLinkSummary": null, "estimate": "PT0S", "externalId": "50078", "fixedVersions": ["PDB 6.12.0"], "id": "50078", "issueType": "Improvement", "key": "PDB-4839", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "623c13e0a1d81f0069d8e29a", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Big performance impact when upgrading to PuppetDB5/6", "timeSpent": "PT0S", "updated": "2022-02-10T08:01:00.000000", "votes": "1", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2020-07-22T17:03:00.000000", "creator": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@3d683366"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hykawv:00000iy601ii09"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_3_*:*_44057008767_*|*_6_*:*_1_*:*_0_*|*_10006_*:*_2_*:*_2501139657"}], "description": "Figure out if we need to account for possible AssertionErrors or other Throwables [here|https://github.com/puppetlabs/puppetdb/blob/master/src/puppetlabs/puppetdb/command.clj#L524-L528]. As is the response-pub-chan used to filter out sync duplicate cmds in the queue and the callback for blocking cmd submission won't be called if eiter class of these errors happen. ", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "48523", "fixedVersions": [], "id": "48523", "issueType": "Improvement", "key": "PDB-4829", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:caae9c58-399c-4716-be37-c404839c368a", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "package / service files need updated for newest systemd", "timeSpent": "PT0S", "updated": "2022-03-03T06:29:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2020-07-08T11:54:00.000000", "creator": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@4753c8db"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|o0d1q7:wui"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Bug Fix"}, {"fieldName": "Release Notes Summary", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textarea", "value": "For the moment, PuppetDB has reverted to its previous behavior which produced much noisier errors in some cases (e.g. for some configuration errors), but the friendlier behavior may be restored in a future release."}], "description": "Assuming something like TK-487 becomes available, use it in cli.services to trigger immediate shutdowns, when appropriate and remove the maintenance-mode workaround.", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "51227", "fixedVersions": [], "id": "51227", "issueType": "Bug", "key": "PDB-4805", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Low (migrated)", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Don't defer shutdown for cases intended to be immediate", "timeSpent": "PT0S", "updated": "2022-02-10T07:46:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2020-07-07T15:32:00.000000", "creator": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@2e61e743"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|o02xf4:"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_46515_*|*_10007_*:*_1_*:*_968039_*|*_3_*:*_1_*:*_83889456_*|*_10009_*:*_1_*:*_162559983_*|*_6_*:*_1_*:*_0"}], "description": "Our previous adjustments to shutdown in a friendlier way for appropriate errors (PDB-4627) ecb22d3a0fc4579d5e94075d57634bdf6df880fa, we ended up deferring some shutdowns that should have been immediate (i.e. if the config were broken). because request-shutdown only initiates the shutdown after all services have finished starting (if none of them throw an exception).\u00a0 This is a problem because the PuppetDBServer was not necessarily left in a consistent state for other dependent services like the command dispatcher.\n\nSince TK doesn't have a way to initiate an immediate friendly shutdown yet, as a mitigation, just make sure we can't come out of maintenance mode during the unavoidably deferred shutdowns, until we resolve PDB-4805.", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "50607", "fixedVersions": ["PDB 6.11.2"], "id": "50607", "issueType": "Bug", "key": "PDB-4804", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "623c168594742a00683e4426", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "PuppetDB deb should depend on Java 11 or Java 8", "timeSpent": "PT0S", "updated": "2022-02-10T07:50:00.000000", "votes": "1", "watchers": []}, {"affectedVersions": [], "assignee": "6220dbdaa12450006887cfd3", "attachments": [], "comments": [{"author": "6220dbdaa12450006887cfd3", "body": "I'm not sure we want to remove the v1 metrics docs completely like the ticket says. Puppetserver still has docs up for their v1 endpoint. Our docs' navigation tree was missing the docs for v2 and that's definitely an issue. PR #3640 adds this missing navigation tree link.", "created": "2022-02-15T14:16:00.000000"}], "components": ["PuppetDB"], "created": "2020-06-05T14:28:00.000000", "creator": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@55ea4e46"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "Epic Link", "fieldType": "com.pyxis.greenhopper.jira:gh-epic-link", "value": "PDB-4759"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hyk7db:630ji"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "Story Points", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:float", "value": "1.0"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "15/Feb/22"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_53471257879_*|*_3_*:*_1_*:*_23421588_*|*_10009_*:*_1_*:*_156703133_*|*_5_*:*_1_*:*_0"}], "description": "We still have docs up for the setup of v1 metrics which have been disabled due to a security issue. We're now only supporting our v2 metrics endpoint which uses jolokia. We should update our foss docs to reflect this change following the pattern found in the puppetserver metrics docs.\u00a0\n\n[current v1 docs|https://puppet.com/docs/puppetdb/latest/api/metrics/v1/mbeans.html]\n\n[puppetserver example for v2 docs with jolokia|https://puppet.com/docs/puppetserver/latest/metrics-api/v2/metrics_api.html]", "epicLinkSummary": "Improvements to PuppetDB's Documentation", "estimate": "PT0S", "externalId": "51631", "fixedVersions": ["PDB 6.21.0", "PDB 7.10.0"], "id": "51631", "issueType": "Improvement", "key": "PDB-4773", "labels": ["docs"], "originalEstimate": "PT0S", "parent": "50600", "parentSummary": "Improvements to PuppetDB's Documentation", "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Improvements to PuppetDB's Documentation", "timeSpent": "PT0S", "updated": "2022-01-17T12:36:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2020-05-28T15:31:00.000000", "creator": "557058:9e548bcc-dbc3-4c04-a047-0344921dbb97", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@7f68651b"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|o025e8:"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "Release Notes Summary", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textarea", "value": "We were building ubuntu 16 PE packages, but we weren't shipping them."}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_72611534_*|*_10007_*:*_1_*:*_227035_*|*_3_*:*_2_*:*_1031432991_*|*_5_*:*_1_*:*_0_*|*_10004_*:*_1_*:*_7882641905"}], "description": "Remove ubuntu-16.04-amd64 for pe-puppetdb\n\n* For Clojure projects, change the puppetlabs/lein-ezbake version in the project.clj file to a version that\n no longer includes the platform. This can be retrieved from the ezbake changelog.\n\n* For Vanagon projects, remove the configuration file in configs/platforms for ubuntu-16.04-amd64 and remove\n ubuntu-16.04-amd64 from ext/build_defaults.yaml\n", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "51719", "fixedVersions": ["PDB 6.13.0"], "id": "51719", "issueType": "Task", "key": "PDB-4758", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:9f6ff9a9-4f34-4d8d-a759-5b36bf88ecd1", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Docs: man command error on PuppetDB CLI page", "timeSpent": "PT0S", "updated": "2022-03-03T06:28:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2020-05-21T14:20:00.000000", "creator": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@4a46b4f5"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hykawv:00000ikk"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_1027058151_*|*_10007_*:*_1_*:*_112751956_*|*_3_*:*_1_*:*_2434301_*|*_10009_*:*_1_*:*_402282038_*|*_5_*:*_1_*:*_0_*|*_10006_*:*_1_*:*_6240373684"}], "description": "{code}\nlein test :only puppetlabs.puppetdb.acceptance.node-ttl/configure-expiration-behavior\n\nFAIL in (configure-expiration-behavior) (node_ttl.clj:133)\nfacts don't expire/purge when expire configured to false\nexpected: (tc/after? (now) (-> result first (get \"expired\") parse-wire-datetime))\n actual: (not (tc/after? #object[org.joda.time.DateTime 0x6e02ebd4 \"2020-05-21T19:30:39.726Z\"] nil))\n\nlein test :only puppetlabs.puppetdb.acceptance.node-ttl/configure-expiration-behavior\n\nFAIL in (configure-expiration-behavior) (node_ttl.clj:139)\nfacts don't expire/purge when expire configured to false\nexpected: (= [{\"certname\" \"foo\", \"expired\" nil}] (nodes))\n actual: (not (= [{\"certname\" \"foo\", \"expired\" nil}] ({\"certname\" \"bar\", \"expired\" nil} {\"certname\" \"foo\", \"expired\" nil})))\n\nlein test :only puppetlabs.puppetdb.acceptance.node-ttl/configure-expiration-behavior\n\nFAIL in (configure-expiration-behavior) (node_ttl.clj:148)\nchanging expiration from false to true allows expire/purge\nexpected: (= 1 (count result))\n actual: (not (= 1 2))\n\nlein test :only puppetlabs.puppetdb.acceptance.node-ttl/configure-expiration-behavior\n\nFAIL in (configure-expiration-behavior) (node_ttl.clj:149)\nchanging expiration from false to true allows expire/purge\nexpected: (= \"foo\" (-> result first (get \"certname\")))\n actual: (not (= \"foo\" \"bar\"))\n{code}\n", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "49666", "fixedVersions": ["PDB n/a"], "id": "49666", "issueType": "Bug", "key": "PDB-4745", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "623c0aba7910a200718b90a4", "resolution": "Duplicate", "resolutionDate": "2020-05-05T12:04:00.000000", "status": "Closed", "statusCategory": "Done", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "Migration state not correctly detected", "timeSpent": "PT0S", "updated": "2022-01-17T17:40:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [{"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "Thanks [~accountid:557058:e0389099-cc54-4f97-bd2a-7fa4735554bd] for reporting this! We'll get it fixed ASAP and are tracking the work under PDB-4709.", "created": "2020-05-05T12:03:00.000000"}], "components": ["PuppetDB"], "created": "2020-05-04T03:49:00.000000", "creator": "557058:e0389099-cc54-4f97-bd2a-7fa4735554bd", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@6291486c"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|o01owo:"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "05/May/20"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_116047791_*|*_6_*:*_1_*:*_0"}], "description": "Our PuppetDB installation was upgraded from 5.2.13 to 5.2.14. As soon as this happened PuppetDB wouldn't start and was throwing this error continuously:\n{noformat}\n2020-05-02 18:25:14,326 INFO [o.e.j.u.log] Logging initialized @21674ms to org.eclipse.jetty.util.log.Slf4jLog\n2020-05-02 18:25:16,717 INFO [p.t.s.w.jetty9-service] Initializing web server(s).\n2020-05-02 18:25:16,788 INFO [p.p.pdb-routing] Starting PuppetDB, entering maintenance mode\n2020-05-02 18:25:16,835 INFO [p.t.s.s.status-service] Registering status callback function for service 'puppetdb-status', version 5.2.14\n2020-05-02 18:25:16,851 INFO [p.t.s.n.nrepl-service] nREPL service disabled, not starting\n2020-05-02 18:25:16,872 INFO [p.t.s.w.jetty9-service] Starting web server(s).\n2020-05-02 18:25:17,050 INFO [p.t.s.w.jetty9-core] Starting web server.\n2020-05-02 18:25:17,055 INFO [o.e.j.s.Server] jetty-9.4.z-SNAPSHOT; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_181-b25\n2020-05-02 18:25:17,097 INFO [o.e.j.s.h.ContextHandler] Started o.e.j.s.h.ContextHandler@6919ef0{/pdb,null,AVAILABLE}\n2020-05-02 18:25:17,113 INFO [o.e.j.s.session] DefaultSessionIdManager workerName=node0\n2020-05-02 18:25:17,113 INFO [o.e.j.s.session] No SessionScavenger set, using defaults\n2020-05-02 18:25:17,115 INFO [o.e.j.s.session] node0 Scavenging every 660000ms\n2020-05-02 18:25:17,140 INFO [p.t.s.m.jolokia] Using policy access restrictor classpath:/jolokia-access.xml\n2020-05-02 18:25:17,187 INFO [o.e.j.s.h.ContextHandler] Started o.e.j.s.ServletContextHandler@127b9f1a{/metrics/v2,null,AVAILABLE}\n2020-05-02 18:25:17,210 INFO [o.e.j.s.AbstractConnector] Started ServerConnector@d3e4c64{HTTP/1.1,[http/1.1]}{localhost:8080}\n2020-05-02 18:25:17,216 INFO [o.e.j.u.s.SslContextFactory] x509=X509@67959c04(private key,h=[p-slo-vl003.aspectcapital.com, puppet, puppet.aspectcapital.com],w=[]) for InternalSslContextFactory@1246c2e3[provider=null,keyStore=null,trustStore=null]\n2020-05-02 18:25:17,231 INFO [o.e.j.s.AbstractConnector] Started ServerConnector@32de065e{SSL,[ssl, http/1.1]}{0.0.0.0:8081}\n2020-05-02 18:25:17,232 INFO [o.e.j.s.Server] Started @24582ms\n2020-05-02 18:25:17,238 INFO [p.t.s.s.status-core] Starting background monitoring of cpu usage metrics\n2020-05-02 18:25:17,244 INFO [p.t.s.s.status-service] Registering status callback function for service 'status-service', version 0.7.1\n2020-05-02 18:25:17,245 INFO [p.t.s.s.status-service] Registering status service HTTP API at /status\n2020-05-02 18:25:17,261 INFO [o.e.j.s.h.ContextHandler] Started o.e.j.s.h.ContextHandler@90decb{/status,null,AVAILABLE}\n2020-05-02 18:25:17,267 INFO [p.p.c.services] PuppetDB version 5.2.14\n2020-05-02 18:25:17,271 INFO [c.z.h.HikariDataSource] PDBMigrationsPool - Starting...\n2020-05-02 18:25:17,288 INFO [c.z.h.HikariDataSource] PDBMigrationsPool - Start completed.\n2020-05-02 18:25:17,438 INFO [p.p.s.migrate] Locking migrations table before migrating\n2020-05-02 18:25:17,461 INFO [c.z.h.HikariDataSource] PDBMigrationsPool - Shutdown initiated...\n2020-05-02 18:25:17,481 INFO [c.z.h.HikariDataSource] PDBMigrationsPool - Shutdown completed.\n2020-05-02 18:25:17,483 ERROR [p.t.internal] Error during service start!!!\njava.lang.IllegalStateException: Your PuppetDB database contains a schema migration numbered 1, but this version of PuppetDB does not recognize that version.\n at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)\n at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)\n at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)\n at java.lang.reflect.Constructor.newInstance(Constructor.java:423)\n at clojure.lang.Reflector.invokeConstructor(Reflector.java:180)\n at puppetlabs.puppetdb.scf.migrate$require_valid_schema.invokeStatic(migrate.clj:1635)\n at puppetlabs.puppetdb.scf.migrate$require_valid_schema.invoke(migrate.clj:1616)\n at puppetlabs.puppetdb.scf.migrate$update_schema$fn__41067.invoke(migrate.clj:1767)\n at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:628)\n at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:598)\n at puppetlabs.puppetdb.scf.migrate$update_schema.invokeStatic(migrate.clj:1762)\n at puppetlabs.puppetdb.scf.migrate$update_schema.invoke(migrate.clj:1728)\n at puppetlabs.puppetdb.scf.migrate$initialize_schema.invokeStatic(migrate.clj:1800)\n at puppetlabs.puppetdb.scf.migrate$initialize_schema.invoke(migrate.clj:1793)\n at puppetlabs.puppetdb.scf.migrate$initialize_schema.invokeStatic(migrate.clj:1797)\n at puppetlabs.puppetdb.scf.migrate$initialize_schema.invoke(migrate.clj:1793)\n at puppetlabs.puppetdb.cli.services$prep_db.invokeStatic(services.clj:396)\n at puppetlabs.puppetdb.cli.services$prep_db.invoke(services.clj:389)\n at puppetlabs.puppetdb.cli.services$init_with_db$fn__41346.invoke(services.clj:447)\n at puppetlabs.puppetdb.cli.services$init_with_db.invokeStatic(services.clj:444)\n at puppetlabs.puppetdb.cli.services$init_with_db.invoke(services.clj:412)\n at puppetlabs.puppetdb.cli.services$start_puppetdb.invokeStatic(services.clj:562)\n at puppetlabs.puppetdb.cli.services$start_puppetdb.invoke(services.clj:543)\n at puppetlabs.puppetdb.cli.services$start_puppetdb_or_shutdown$fn__41393.invoke(services.clj:662)\n at puppetlabs.puppetdb.cli.services$start_puppetdb_or_shutdown.invokeStatic(services.clj:661)\n at puppetlabs.puppetdb.cli.services$start_puppetdb_or_shutdown.invoke(services.clj:656)\n at puppetlabs.puppetdb.cli.services$reify__41527$service_fnk__13710__auto___positional$reify__41538.start(services.clj:760)\n at puppetlabs.trapperkeeper.services$eval13512$fn__13526$G__13502__13529.invoke(services.clj:9)\n at puppetlabs.trapperkeeper.services$eval13512$fn__13526$G__13501__13533.invoke(services.clj:9)\n at puppetlabs.trapperkeeper.internal$eval26182$run_lifecycle_fn_BANG___26189$fn__26190.invoke(internal.clj:198)\n at puppetlabs.trapperkeeper.internal$eval26182$run_lifecycle_fn_BANG___26189.invoke(internal.clj:181)\n at puppetlabs.trapperkeeper.internal$eval26211$run_lifecycle_fns__26216$fn__26217.invoke(internal.clj:231)\n at puppetlabs.trapperkeeper.internal$eval26211$run_lifecycle_fns__26216.invoke(internal.clj:208)\n at puppetlabs.trapperkeeper.internal$eval26693$build_app_STAR___26702$fn$reify__26712.start(internal.clj:586)\n at puppetlabs.trapperkeeper.internal$eval26739$boot_services_for_app_STAR__STAR___26746$fn__26747$fn__26749.invoke(internal.clj:612)\n at puppetlabs.trapperkeeper.internal$eval26739$boot_services_for_app_STAR__STAR___26746$fn__26747.invoke(internal.clj:610)\n at puppetlabs.trapperkeeper.internal$eval26739$boot_services_for_app_STAR__STAR___26746.invoke(internal.clj:604)\n at clojure.core$partial$fn__4761.invoke(core.clj:2521)\n at puppetlabs.trapperkeeper.internal$eval26252$initialize_lifecycle_worker__26263$fn__26264$fn__26360$state_machine__18333__auto____26361$fn__26363.invoke(internal.clj:251)\n at puppetlabs.trapperkeeper.internal$eval26252$initialize_lifecycle_worker__26263$fn__26264$fn__26360$state_machine__18333__auto____26361.invoke(internal.clj:251)\n at clojure.core.async.impl.ioc_macros$run_state_machine.invokeStatic(ioc_macros.clj:1012)\n at clojure.core.async.impl.ioc_macros$run_state_machine.invoke(ioc_macros.clj:1011)\n at clojure.core.async.impl.ioc_macros$run_state_machine_wrapped.invokeStatic(ioc_macros.clj:1016)\n at clojure.core.async.impl.ioc_macros$run_state_machine_wrapped.invoke(ioc_macros.clj:1014)\n at clojure.core.async$ioc_alts_BANG_$fn__18501.invoke(async.clj:383)\n at clojure.core.async$do_alts$fn__18447$fn__18450.invoke(async.clj:252)\n at clojure.core.async.impl.channels.ManyToManyChannel$fn__17059$fn__17060.invoke(channels.clj:95)\n at clojure.lang.AFn.run(AFn.java:22)\n at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n at java.lang.Thread.run(Thread.java:748)\n2020-05-02 18:25:17,492 INFO [p.t.internal] Beginning shutdown sequence\n2020-05-02 18:25:17,509 INFO [p.p.command] Halted delayed command processsing\n2020-05-02 18:25:17,515 INFO [p.p.c.services] Shutdown request received; puppetdb exiting.\n2020-05-02 18:25:17,516 INFO [p.p.c.services] Periodic activities halted\n2020-05-02 18:25:17,519 INFO [p.t.s.w.jetty9-service] Shutting down web server(s).\n2020-05-02 18:25:17,524 INFO [p.t.s.w.jetty9-core] Shutting down web server.\n2020-05-02 18:25:17,529 INFO [o.e.j.s.AbstractConnector] Stopped ServerConnector@d3e4c64{HTTP/1.1,[http/1.1]}{localhost:8080}\n2020-05-02 18:25:17,530 INFO [o.e.j.s.AbstractConnector] Stopped ServerConnector@32de065e{SSL,[ssl, http/1.1]}{0.0.0.0:8081}\n2020-05-02 18:25:17,530 INFO [o.e.j.s.session] node0 Stopped scavenging\n2020-05-02 18:25:17,530 INFO [o.e.j.s.h.ContextHandler] Stopped o.e.j.s.h.ContextHandler@90decb{/status,null,UNAVAILABLE}\n2020-05-02 18:25:17,532 INFO [o.e.j.s.h.ContextHandler] Stopped o.e.j.s.ServletContextHandler@127b9f1a{/metrics/v2,null,UNAVAILABLE}\n2020-05-02 18:25:17,532 INFO [o.e.j.s.h.ContextHandler] Stopped o.e.j.s.h.ContextHandler@6919ef0{/pdb,null,UNAVAILABLE}\n2020-05-02 18:25:17,534 INFO [p.t.s.w.jetty9-core] Web server shutdown\n2020-05-02 18:25:17,537 INFO [p.t.internal] Finished shutdown sequence\n2020-05-02 18:25:17,544 ERROR [p.t.logging] Uncaught exception\njava.lang.IllegalStateException: Your PuppetDB database contains a schema migration numbered 1, but this version of PuppetDB does not recognize that version.\n at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)\n at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)\n at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)\n at java.lang.reflect.Constructor.newInstance(Constructor.java:423)\n at clojure.lang.Reflector.invokeConstructor(Reflector.java:180)\n at puppetlabs.puppetdb.scf.migrate$require_valid_schema.invokeStatic(migrate.clj:1635)\n at puppetlabs.puppetdb.scf.migrate$require_valid_schema.invoke(migrate.clj:1616)\n at puppetlabs.puppetdb.scf.migrate$update_schema$fn__41067.invoke(migrate.clj:1767)\n at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:628)\n at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:598)\n at puppetlabs.puppetdb.scf.migrate$update_schema.invokeStatic(migrate.clj:1762)\n at puppetlabs.puppetdb.scf.migrate$update_schema.invoke(migrate.clj:1728)\n at puppetlabs.puppetdb.scf.migrate$initialize_schema.invokeStatic(migrate.clj:1800)\n at puppetlabs.puppetdb.scf.migrate$initialize_schema.invoke(migrate.clj:1793)\n at puppetlabs.puppetdb.scf.migrate$initialize_schema.invokeStatic(migrate.clj:1797)\n at puppetlabs.puppetdb.scf.migrate$initialize_schema.invoke(migrate.clj:1793)\n at puppetlabs.puppetdb.cli.services$prep_db.invokeStatic(services.clj:396)\n at puppetlabs.puppetdb.cli.services$prep_db.invoke(services.clj:389)\n at puppetlabs.puppetdb.cli.services$init_with_db$fn__41346.invoke(services.clj:447)\n at puppetlabs.puppetdb.cli.services$init_with_db.invokeStatic(services.clj:444)\n at puppetlabs.puppetdb.cli.services$init_with_db.invoke(services.clj:412)\n at puppetlabs.puppetdb.cli.services$start_puppetdb.invokeStatic(services.clj:562)\n at puppetlabs.puppetdb.cli.services$start_puppetdb.invoke(services.clj:543)\n at puppetlabs.puppetdb.cli.services$start_puppetdb_or_shutdown$fn__41393.invoke(services.clj:662)\n at puppetlabs.puppetdb.cli.services$start_puppetdb_or_shutdown.invokeStatic(services.clj:661)\n at puppetlabs.puppetdb.cli.services$start_puppetdb_or_shutdown.invoke(services.clj:656)\n at puppetlabs.puppetdb.cli.services$reify__41527$service_fnk__13710__auto___positional$reify__41538.start(services.clj:760)\n at puppetlabs.trapperkeeper.services$eval13512$fn__13526$G__13502__13529.invoke(services.clj:9)\n at puppetlabs.trapperkeeper.services$eval13512$fn__13526$G__13501__13533.invoke(services.clj:9)\n at puppetlabs.trapperkeeper.internal$eval26182$run_lifecycle_fn_BANG___26189$fn__26190.invoke(internal.clj:198)\n at puppetlabs.trapperkeeper.internal$eval26182$run_lifecycle_fn_BANG___26189.invoke(internal.clj:181)\n at puppetlabs.trapperkeeper.internal$eval26211$run_lifecycle_fns__26216$fn__26217.invoke(internal.clj:231)\n at puppetlabs.trapperkeeper.internal$eval26211$run_lifecycle_fns__26216.invoke(internal.clj:208)\n at puppetlabs.trapperkeeper.internal$eval26693$build_app_STAR___26702$fn$reify__26712.start(internal.clj:586)\n at puppetlabs.trapperkeeper.internal$eval26739$boot_services_for_app_STAR__STAR___26746$fn__26747$fn__26749.invoke(internal.clj:612)\n at puppetlabs.trapperkeeper.internal$eval26739$boot_services_for_app_STAR__STAR___26746$fn__26747.invoke(internal.clj:610)\n at puppetlabs.trapperkeeper.internal$eval26739$boot_services_for_app_STAR__STAR___26746.invoke(internal.clj:604)\n at clojure.core$partial$fn__4761.invoke(core.clj:2521)\n at puppetlabs.trapperkeeper.internal$eval26252$initialize_lifecycle_worker__26263$fn__26264$fn__26360$state_machine__18333__auto____26361$fn__26363.invoke(internal.clj:251)\n at puppetlabs.trapperkeeper.internal$eval26252$initialize_lifecycle_worker__26263$fn__26264$fn__26360$state_machine__18333__auto____26361.invoke(internal.clj:251)\n at clojure.core.async.impl.ioc_macros$run_state_machine.invokeStatic(ioc_macros.clj:1012)\n at clojure.core.async.impl.ioc_macros$run_state_machine.invoke(ioc_macros.clj:1011)\n at clojure.core.async.impl.ioc_macros$run_state_machine_wrapped.invokeStatic(ioc_macros.clj:1016)\n at clojure.core.async.impl.ioc_macros$run_state_machine_wrapped.invoke(ioc_macros.clj:1014)\n at clojure.core.async$ioc_alts_BANG_$fn__18501.invoke(async.clj:383)\n at clojure.core.async$do_alts$fn__18447$fn__18450.invoke(async.clj:252)\n at clojure.core.async.impl.channels.ManyToManyChannel$fn__17059$fn__17060.invoke(channels.clj:95)\n at clojure.lang.AFn.run(AFn.java:22)\n at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n at java.lang.Thread.run(Thread.java:748) {noformat}\nThis error gets looped over and over again. Downgrading back to 5.2.13 got things working again.", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "50160", "fixedVersions": [], "id": "50160", "issueType": "Bug", "key": "PDB-4710", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:0a2bfc9c-1912-49b1-9776-665ef20c8769", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "Docs: Replace .each with .map in API query example", "timeSpent": "PT0S", "updated": "2022-03-03T06:27:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "attachments": [], "comments": [{"author": "557058:252602f6-56c9-47a2-a176-2c9c57106330", "body": "Working on master 2019.6.0-rc2-60-ge16e31b, but that's with replication streaming, so probably no sync after. I'll check 2019.5.0.\n\n{code}\n[root@medical-singing pe_manager]# cat /opt/puppetlabs/server/pe_build ", "created": "2020-04-02T13:20:00.000000"}, {"author": "557058:252602f6-56c9-47a2-a176-2c9c57106330", "body": "Don't see it in 2019.5.0, which relies on puppetdb sync like 2018.1, to sync the replica:\n\n{code}\n[root@wrong-coastline ~]# cat /opt/puppetlabs/server/pe_build ", "created": "2020-04-02T15:17:00.000000"}], "components": ["PuppetDB"], "created": "2020-04-02T12:54:00.000000", "creator": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Acceptance Criteria", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textarea", "value": "- Sync status is updated to finished when sync ends\n- puppet infra status output is back to the expected "}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@18a32d0f"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|o014h4:"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "Story Points", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:float", "value": "2.0"}, {"fieldName": "Zendesk Ticket Count", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:float", "value": "1.0"}, {"fieldName": "Zendesk Ticket IDs", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textarea", "value": "39812"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "02/Apr/20"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "10008_*:*_1_*:*_86953093_*|*_1_*:*_1_*:*_942568129_*|*_10007_*:*_1_*:*_769780924_*|*_3_*:*_1_*:*_613542414_*|*_5_*:*_1_*:*_0_*|*_10011_*:*_1_*:*_451275571"}], "description": "In an fresh HA install of 2018.1 with only one node the `puppet infra status` command outputs \n{code}\nPuppetDB: Running on Primary Master Replica, https://shifty-syndrome.delivery.puppetlabs.net:8081/pdb\n Info: Transferring 1 catalogs\n Info: Transferring 1 facts\n Info: Transferring 1 reports\n{code}\n\nwhen it is expected to output something like\n{code}\nPuppetDB: Running on Primary Master, https://prewar-aunt.delivery.puppetlabs.net:8081/pdb\n Info: Last sync successfully completed 84 seconds ago (at 2020-04-02T18:26:45.702Z)\n{code}\n\nthe puppet infra status pulls information from the PuppetDB status endpoint, which also appears to not get updated.\n{code}\n[root@prewar-aunt ~]# curl -k https://shifty-syndrome.delivery.puppetlabs.net:8081/status/v1/services/puppetdb-status | python -m json.toolssage\":\"Transferring 1 reports\"}],\"service_name\":\"puppetdb-status\"}[rpet % Total % Received % Xferd Average Speed Time Time Time Current\n Dload Upload Total Spent Left Speed\n100 628 100 628 0 0 3895 0 --:--:-- --:--:-- --:--:-- 3900\n{\n \"active_alerts\": [\n {\n \"message\": \"Transferring 1 catalogs\",\n \"severity\": \"info\"\n },\n {\n \"message\": \"Transferring 1 facts\",\n \"severity\": \"info\"\n },\n {\n \"message\": \"Transferring 1 reports\",\n \"severity\": \"info\"\n }\n ],\n \"detail_level\": \"info\",\n \"service_name\": \"puppetdb-status\",\n \"service_status_version\": 1,\n \"service_version\": \"5.2.13-20200306_164346-g6063f2b\",\n \"state\": \"running\",\n \"status\": {\n \"maintenance_mode?\": false,\n \"queue_depth\": 0,\n \"rbac_status\": \"running\",\n \"read_db_up?\": true,\n \"sync_status\": {\n \"entity_status\": {\n \"catalogs\": {\n \"phase\": \"transfer\",\n \"total\": 1\n },\n \"factsets\": {\n \"phase\": \"transfer\",\n \"total\": 1\n },\n \"reports\": {\n \"phase\": \"transfer\",\n \"total\": 1\n }\n },\n \"state\": \"syncing\"\n },\n \"write_db_up?\": true\n }\n}\n{code}", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "50650", "fixedVersions": ["PDB 5.2.14", "PDB 6.10.0"], "id": "50650", "issueType": "Improvement", "key": "PDB-4682", "labels": ["jira_escalated"], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "resolution": "Fixed", "resolutionDate": "2020-03-11T11:55:00.000000", "status": "Resolved", "statusCategory": "Done", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Add migrate configuration option", "timeSpent": "PT0S", "updated": "2022-01-17T12:35:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [{"author": "557058:252602f6-56c9-47a2-a176-2c9c57106330", "body": "[~accountid:557058:6fc1f430-f771-4686-a97e-21c5e35f9100] Would this be changes from https://github.com/puppetlabs/puppet-enterprise-modules/pull/772 or https://github.com/puppetlabs/puppet-enterprise-modules/pull/842?", "created": "2020-01-23T14:38:00.000000"}, {"author": "557058:6fc1f430-f771-4686-a97e-21c5e35f9100", "body": "I wouldn't expect a decrease in shared_buffers for postgresql to increase PuppetDB's use of memory.\u00a0 The tuning PR reduces connections from PuppetDB to postgresql which should lower the memory use by a few megabytes.\u00a0 The rest of the tuning doesn't apply to a standard install of PE.\u00a0\u00a0\n\nI would expect the difference in 2019.3 to be related to the change to java 11 and the default GC change.\u00a0\u00a0", "created": "2020-01-23T14:54:00.000000"}, {"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "[~accountid:557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced] was the 2019.3 test using java 11 with the new garbage collector?", "created": "2020-02-04T10:02:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "[~accountid:557058:613151bd-b161-4bc3-9e32-335fdcef4d89], the reported dev build was using Java 11 with the new GC. The variance report failed again on a newer build with the new GC turned off. I will be running this job today with latest dev build and will report back its results.", "created": "2020-02-04T10:12:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "[~accountid:557058:613151bd-b161-4bc3-9e32-335fdcef4d89]\n\nMost recent run for 2019.3 (2020.02.04) [12|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_2019.3/12/]\n\n* 2019.3.0-rc3-44-ga8baef9\n** 2018.1.12 comparison exceeds tolerances:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 713140", "created": "2020-02-05T11:52:00.000000"}, {"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "Thanks [~accountid:557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced] I'll let people know and we'll see what we can do.", "created": "2020-02-05T12:04:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "[Link to job|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/4/BASELINE_PE_VER=2018.1.12,SLAVE_LABEL=worker]\n\n* 2019.4.0-rc3-78-g8ed1026\n** 2018.1.12 comparison exceeds tolerances:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 736287", "created": "2020-02-13T17:13:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-02-17, this tolerance failed when testing recent master build (2019.5.0-rc0-29-gb8100c2) to the LTS baseline (but not STS).\n\n* 2019.5.0-rc0-29-gb8100c2\n** [2018.1.12 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/10/BASELINE_PE_VER=2018.1.12,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 739249", "created": "2020-02-21T09:32:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-02-24, this tolerance failed when testing recent PE master build (2019.5.0-rc0-68-gf0a5db6) to the LTS baseline (but not STS).\n\n* 2019.5.0-rc0-68-gf0a5db6\n** [2018.1.12 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/12/BASELINE_PE_VER=2018.1.12,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 733145", "created": "2020-02-26T09:08:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-03-02, this tolerance failed when testing recent PE master build (2019.5.0-rc0-399-g3d3203b) to the LTS baseline (but not STS).\n\n* 2019.5.0-rc0-399-g3d3203b\n** [2018.1.12 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/14/BASELINE_PE_VER=2018.1.12,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 715959", "created": "2020-03-04T09:51:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-03-09, this tolerance failed when testing recent PE master build (2019.5.0-rc0-520-gab23aad) to the LTS baseline (but not STS).\n\n* 2019.5.0-rc0-520-gab23aad\n** [2018.1.13 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/19/BASELINE_PE_VER=2018.1.13,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 725263", "created": "2020-03-13T11:06:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-03-16, this tolerance failed when testing recent PE master build (2019.5.0-rc1-16-gb20eb01) to the LTS baseline (but not STS).\n\n* 2019.5.0-rc1-16-gb20eb01\n** [2018.1.13 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/20/BASELINE_PE_VER=2018.1.13,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 714239", "created": "2020-03-18T08:27:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-03-23, this tolerance failed when testing recent PE master build (2019.6.0-rc2-16-g099cf6a) to the LTS baseline (but not STS).\n\n* 2019.6.0-rc2-16-g099cf6a\n** [2018.1.13 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/22/BASELINE_PE_VER=2018.1.13,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 719128", "created": "2020-03-24T15:43:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-03-30, this tolerance failed when testing recent PE master build (2019.6.0-rc2-26-g21f8c4c) to the LTS baseline (but not STS).\n\n* 2019.6.0-rc2-26-g21f8c4c\n** [2018.1.13 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/25/BASELINE_PE_VER=2018.1.13,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 730773", "created": "2020-04-01T16:47:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-04-06, this tolerance failed when testing recent PE master build (2019.7.0-rc0-11-g427cad1) to the LTS baseline (but not STS).\n\n* 2019.7.0-rc0-11-g427cad1\n** [2018.1.13 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/26/BASELINE_PE_VER=2018.1.13,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 730773", "created": "2020-04-07T14:56:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-04-13, this tolerance failed when testing recent PE master build (2019.7.0-rc0-49-g5037017) to the LTS baseline (but not STS).\n\n* 2019.7.0-rc0-49-g5037017\n** [2018.1.13 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/28/BASELINE_PE_VER=2018.1.13,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 730773", "created": "2020-04-14T11:06:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-04-20, this tolerance failed when testing recent PE master build (2019.7.0-rc0-84-gf9ac17e) to the LTS baseline (but not STS).\n\n* 2019.7.0-rc0-84-gf9ac17e\n** [2018.1.14 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/29/BASELINE_PE_VER=2018.1.14,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 730893", "created": "2020-04-23T08:30:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-04-27, this tolerance failed when testing recent PE master build (2019.7.0-rc1-15-gcd7efbb) to the LTS baseline (but not STS).\n\n* 2019.7.0-rc1-15-gcd7efbb\n** [2018.1.14 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/30/BASELINE_PE_VER=2018.1.14,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 730893", "created": "2020-04-28T08:28:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-05-04, this tolerance failed when testing recent PE master build (2019.8.0-rc0-7-g4277622) to the LTS baseline (but not STS).\n\n* 2019.8.0-rc0-7-g4277622\n** [2018.1.14 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/31/BASELINE_PE_VER=2018.1.14,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 730893", "created": "2020-05-05T08:14:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-05-11, this tolerance failed when testing recent PE master build (2019.8.0-rc0-108-ga105716) to the LTS baseline (but not STS).\n\n* 2019.8.0-rc0-108-ga105716\n** [2018.1.15 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/35/BASELINE_PE_VER=2018.1.15,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 720443", "created": "2020-05-14T08:53:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-05-18, this tolerance failed when testing recent PE master build (2019.8.0-rc1-17-gf233795) to the LTS baseline (but not STS).\n\n* 2019.8.0-rc1-17-gf233795\n** [2018.1.15 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/37/BASELINE_PE_VER=2018.1.15,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 720443", "created": "2020-05-22T11:03:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "For the performance comparison run of week 2020-05-25, this tolerance failed when testing recent PE master build (2019.8.0-rc3-5-g3b0d0bc) to the LTS baseline (but not STS).\n\n* 2019.8.0-rc3-5-g3b0d0bc\n** [2018.1.15 comparison|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_master/38/BASELINE_PE_VER=2018.1.15,SLAVE_LABEL=worker/console]:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 720443", "created": "2020-05-26T12:00:00.000000"}, {"author": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "body": "Given that this failure is consistently against the 2018.1.x LTS release and we will be cutting a new LTS next month, this issue seems moot. I will update the CI job to suppress this metric when comparing master builds to the 2018.1.x LTS going forward.", "created": "2020-05-26T15:45:00.000000"}], "components": ["PuppetDB"], "created": "2020-01-23T14:24:00.000000", "creator": "557058:b3e6b0df-198d-45f8-9ba5-d41f90e80ced", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@79c58354"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Automated Test"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hzzn9j:"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "23/Jan/20"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_10714863713_*|*_6_*:*_1_*:*_0"}], "description": "Performance comparison runs of recent PE builds for 2019.1 and 2019.3 reveal that PuppetDB in these builds are using more memory than it does in the PE 2018.1.11 baseline. The current threshold for this alert is a variation greater than 10%. Although the 2019.1.4-rc0-228-g062cb5b result is only slightly higher than this threshold, 2019.3.0-rc3-4-ged33755 has reported memory usage 30% higher than the 2018.1.11 baseline.\n\nThese results may be indicative of a memory/performance issue with PuppetDB\n\n[Link to 2019.1 job|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_2019.1/5/]\n* 2019.1.4-rc0-228-g062cb5b\n** 2018.1.11 comparison exceeds tolerances:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 695206; result: 768371; variance: 10.52%\n\n[Link to 2019.3 job|https://cinext-jenkinsmaster-enterprise-prod-1.delivery.puppetlabs.net/view/gatling-puppet-load-test/job/enterprise_gatling-puppet-load-test_gatling-test_applestoapples_2019.3/7/]\n* 2019.3.0-rc3-4-ged33755\n** 2018.1.11 comparison exceeds tolerances:\n*** Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 695206; result: 905635; variance: 30.27%", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "49042", "fixedVersions": [], "id": "49042", "issueType": "Bug", "key": "PDB-4635", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

HTTP ERROR 500

Problem accessing /pdb/query/v4. Reason:\n

    Server Error

Caused by:

javax.servlet.ServletException: org.postgresql.util.PSQLException: ERROR: missing FROM-clause entry for table "facts"\n  Position: 614\n        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:168)\n        at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:753)\n        at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:56)\n        at com.puppetlabs.trapperkeeper.services.webserver.jetty9.utils.MDCRequestLogHandler.handle(MDCRequestLogHandler.java:36)\n        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)\n        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)\n        at org.eclipse.jetty.server.Server.handle(Server.java:505)\n        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)\n        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)\n        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)\n        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)\n        at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:427)\n        at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:321)\n        at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:159)\n        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)\n        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)\n        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)\n        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)\n        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)\n        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)\n        at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)\n        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:698)\n        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:804)\n        at java.lang.Thread.run(Thread.java:748)\nCaused by: org.postgresql.util.PSQLException: ERROR: missing FROM-clause entry for table "facts"\n  Position: 614\n        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2433)\n        at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2178)\n        at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:306)\n        at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441)\n        at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365)\n        at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:155)\n        at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:118)\n        at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52)\n        at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java)\n        at puppetlabs.puppetdb.jdbc$call_with_array_converted_query_rows$fn__22073.invoke(jdbc.clj:297)\n        at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:814)\n        at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741)\n        at puppetlabs.puppetdb.jdbc$call_with_array_converted_query_rows.invokeStatic(jdbc.clj:289)\n        at puppetlabs.puppetdb.jdbc$call_with_array_converted_query_rows.invoke(jdbc.clj:272)\n        at puppetlabs.puppetdb.jdbc$call_with_array_converted_query_rows.invokeStatic(jdbc.clj:285)\n        at puppetlabs.puppetdb.jdbc$call_with_array_converted_query_rows.invoke(jdbc.clj:272)\n        at puppetlabs.puppetdb.query_eng$fn__30503$produce_streaming_body__30508$fn__30509$fn__30512$fn__30514$fn__30515.invoke(query_eng.clj:221)\n        at puppetlabs.puppetdb.jdbc$with_transacted_connection_fn$fn__22266$fn__22267.invoke(jdbc.clj:514)\n        at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:771)\n        at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741)\n        at puppetlabs.puppetdb.jdbc$with_transacted_connection_fn$fn__22266.invoke(jdbc.clj:513)\n        at puppetlabs.puppetdb.jdbc$fn__22244$retry_sql_STAR___22249$fn__22250$fn__22251.invoke(jdbc.clj:485)\n        at puppetlabs.puppetdb.jdbc$fn__22244$retry_sql_STAR___22249$fn__22250.invoke(jdbc.clj:484)\n        at puppetlabs.puppetdb.jdbc$fn__22244$retry_sql_STAR___22249.invoke(jdbc.clj:475)\n        at puppetlabs.puppetdb.jdbc$with_transacted_connection_fn.invokeStatic(jdbc.clj:511)\n        at puppetlabs.puppetdb.jdbc$with_transacted_connection_fn.invoke(jdbc.clj:500)\n        at puppetlabs.puppetdb.query_eng$fn__30503$produce_streaming_body__30508$fn__30509$fn__30512$fn__30514.invoke(query_eng.clj:220)\n        at ring.util.io$piped_input_stream$fn__190.invoke(io.clj:28)\n        at clojure.core$binding_conveyor_fn$fn__5754.invoke(core.clj:2030)\n        at clojure.lang.AFn.call(AFn.java:18)\n        at java.util.concurrent.FutureTask.run(FutureTask.java:266)\n        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n        ... 1 more\n

Caused by:

org.postgresql.util.PSQLException: ERROR: missing FROM-clause entry for table "facts"\n  Position: 614\n        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2433)\n        at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2178)\n        at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:306)\n        at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441)\n        at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365)\n        at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:155)\n        at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:118)\n        at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52)\n        at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java)\n        at puppetlabs.puppetdb.jdbc$call_with_array_converted_query_rows$fn__22073.invoke(jdbc.clj:297)\n        at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:814)\n        at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741)\n        at puppetlabs.puppetdb.jdbc$call_with_array_converted_query_rows.invokeStatic(jdbc.clj:289)\n        at puppetlabs.puppetdb.jdbc$call_with_array_converted_query_rows.invoke(jdbc.clj:272)\n        at puppetlabs.puppetdb.jdbc$call_with_array_converted_query_rows.invokeStatic(jdbc.clj:285)\n        at puppetlabs.puppetdb.jdbc$call_with_array_converted_query_rows.invoke(jdbc.clj:272)\n        at puppetlabs.puppetdb.query_eng$fn__30503$produce_streaming_body__30508$fn__30509$fn__30512$fn__30514$fn__30515.invoke(query_eng.clj:221)\n        at puppetlabs.puppetdb.jdbc$with_transacted_connection_fn$fn__22266$fn__22267.invoke(jdbc.clj:514)\n        at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:771)\n        at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741)\n        at puppetlabs.puppetdb.jdbc$with_transacted_connection_fn$fn__22266.invoke(jdbc.clj:513)\n        at puppetlabs.puppetdb.jdbc$fn__22244$retry_sql_STAR___22249$fn__22250$fn__22251.invoke(jdbc.clj:485)\n        at puppetlabs.puppetdb.jdbc$fn__22244$retry_sql_STAR___22249$fn__22250.invoke(jdbc.clj:484)\n        at puppetlabs.puppetdb.jdbc$fn__22244$retry_sql_STAR___22249.invoke(jdbc.clj:475)\n        at puppetlabs.puppetdb.jdbc$with_transacted_connection_fn.invokeStatic(jdbc.clj:511)\n        at puppetlabs.puppetdb.jdbc$with_transacted_connection_fn.invoke(jdbc.clj:500)\n        at puppetlabs.puppetdb.query_eng$fn__30503$produce_streaming_body__30508$fn__30509$fn__30512$fn__30514.invoke(query_eng.clj:220)\n        at ring.util.io$piped_input_stream$fn__190.invoke(io.clj:28)\n        at clojure.core$binding_conveyor_fn$fn__5754.invoke(core.clj:2030)\n        at clojure.lang.AFn.call(AFn.java:18)\n        at java.util.concurrent.FutureTask.run(FutureTask.java:266)\n        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n        at java.lang.Thread.run(Thread.java:748)\n

\n\n\n{code}\nLooking at the postgres logs i see the following error:\n{code:java}\n< 2020-01-20 08:57:40.569 EST > ERROR: missing FROM-clause entry for table \"facts\" at character 614\n< 2020-01-20 08:57:40.569 EST > STATEMENT: WITH inactive_nodes AS (SELECT certname FROM certnames WHERE (deactivated IS NOT NULL OR expired IS NOT NULL)) SELECT certnames.certname AS certname, (fs.stable||fs.volatile)->'wsus_target_group' AS \"facts.wsus_target_group\" FROM factsets fs LEFT JOIN environments ON fs.environment_id = environments.id LEFT JOIN producers ON fs.producer_id = producers.id LEFT JOIN certnames ON fs.certname = certnames.certname WHERE ((fs.stable||fs.volatile) @> $1 AND NOT ((certnames.certname) in (SELECT certname FROM ( (SELECT inactive_nodes.certname AS certname FROM inactive_nodes) ) sub))) GROUP BY certnames.certname, facts.wsus_target_group\n\n{code}\n-------------------\n\nI noticed that in the Postgres query that `facts` isn't actually the name of a table instead its the name of a field and so `facts.wsus_target_group` is parsed by Postgres thinking that `facts` is a table and we're trying to extract `wsus_target_group` field from that.\n\n\nI was able to force inject some quotes in the AST query and got it to work:\n\n\u00a0\n{code:java}\n ['from', 'inventory',\n ['extract',\n [['function', 'count'], 'facts.wsus_target_group', 'certname'],\n ['=', 'facts.osfamily', 'windows'],\n ['group_by', '\\\"facts.wsus_target_group\\\"', 'certname'],\n ],\n ]\n{code}\n\u00a0\n\nI'm not sure the exact right fix, but those extra quotes helped my query return without an error.\n\n\u00a0", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "52723", "fixedVersions": ["PDB 6.19.0", "PDB 7.5.2"], "id": "52723", "issueType": "Bug", "key": "PDB-4628", "labels": ["query-engine-improvements"], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "5beae128c1d1402b40229c7c", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Puppetdb module issues notice every run for postgresql-contrib with postgres11 (on Debian Buster)", "timeSpent": "PT0S", "updated": "2022-02-10T08:28:00.000000", "votes": "1", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [{"author": "61af86343618cd006f430854", "body": "Closing due to lack of activity. If you feel this was in error, feel free to add a comment to explain why you would like to re-open the ticket.\n", "created": "2022-01-12T13:07:00.000000"}], "components": ["PuppetDB"], "created": "2019-12-03T13:13:00.000000", "creator": "557058:c241032a-c552-4408-9a96-dcd5a643ff69", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@4ca3c72"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "Epic Link", "fieldType": "com.pyxis.greenhopper.jira:gh-epic-link", "value": "PUP-10012"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hzysxb:"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "12/Jan/22"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_170401658_*|*_6_*:*_1_*:*_0_*|*_10005_*:*_1_*:*_66443602718"}], "description": "Puppet will be using the key recorder created in SERVER-2687 (see PUP-10156) to record function call evaluations. The PDB terminus needs to pull this data out of the recorder and store it alongside the other catalog inputs, similar to https://github.com/puppetlabs/puppetdb/commit/6a32ee36eb53a7b138132514906bf32b6f1eee63.", "epicLinkSummary": "Impact Analysis: Functions and Templates", "estimate": "PT0S", "externalId": "53225", "fixedVersions": [], "id": "53225", "issueType": "Task", "key": "PDB-4596", "labels": [], "originalEstimate": "PT0S", "parent": "29618", "parentSummary": "Impact Analysis: Functions and Templates", "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:c241032a-c552-4408-9a96-dcd5a643ff69", "status": "Accepted", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Update PDB terminus to pull data out of the template key recorder", "timeSpent": "PT0S", "updated": "2022-03-03T06:26:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2019-11-29T09:20:00.000000", "creator": "557058:9f6ff9a9-4f34-4d8d-a759-5b36bf88ecd1", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@3d1596a6"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "Epic Link", "fieldType": "com.pyxis.greenhopper.jira:gh-epic-link", "value": "PDB-4759"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hyk7db:630i96h8v"}, {"fieldName": "Scrum Team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "PuppetDB"}, {"fieldName": "Story Points", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:float", "value": "1.0"}], "description": "Comment from docs feedback form:\n\n[https://puppet.com/docs/puppetdb/latest/connect_puppet_apply.html]\n\n\n The audience for this article keeps rotating around as though I am many people - am I new to puppet, am I an experienced puppet practitioner? Fact is I am very new to puppet, and this article has me pulling my hair out trying to understand all the various pieces, techniques, strategies for solving this singular problem - even as a functional devops engineer I am having a difficult time following the flow of this page.\u00a0 It's like flipping through a Choose Your Own Adventure book, back to the top, retracing my way back down, remembering in my own head what I've already read on the page and trying the next thing. I really want to participate but it's expensive for me to keep all of this loaded in my head - that's the job of the page. I should just be keeping where I am at the top of the browser and scrolling along with.\u00a0 I've made it to the bottom several times and I feel like this article has evolved like DNA, over many small rewrites, multiple authors, and no one really re-reading the entire article top to bottom to ask the Big Question, 'is this article actually contributing to the problem of how do our users connect puppet agents to puppetdb\".\u00a0 I had to actually verify that was the page I was on before I complained about it, because there isnt even a reference to puppetdb in the url.\u00a0 Thanks for listening.\u00a0 I know it's easy to hate on the reader, because this article will make perfect sense to you guys but remember the value of someone who doesnt have the domain knowledge loaded.\n\n\u00a0", "epicLinkSummary": "Improvements to PuppetDB's Documentation", "estimate": "PT0S", "externalId": "52706", "fixedVersions": [], "id": "52706", "issueType": "Improvement", "key": "PDB-4594", "labels": ["docs-pdb", "feedback-form-docs-site"], "originalEstimate": "PT0S", "parent": "50600", "parentSummary": "Improvements to PuppetDB's Documentation", "priority": "Low (migrated)", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:9f6ff9a9-4f34-4d8d-a759-5b36bf88ecd1", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "PDB docs: Update Connecting standalone Puppet nodes to PuppetDB doc", "timeSpent": "PT0S", "updated": "2022-03-03T06:25:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [{"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "This feedback doesn't really contain enough information to be actionable. We are updating a few terms on this page that have changed more recently than its been updated in another ticket.", "created": "2020-08-06T16:32:00.000000"}], "components": ["PuppetDB"], "created": "2019-11-29T09:10:00.000000", "creator": "557058:9f6ff9a9-4f34-4d8d-a759-5b36bf88ecd1", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@60467279"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "Epic Link", "fieldType": "com.pyxis.greenhopper.jira:gh-epic-link", "value": "PDB-4759"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hzyqxb:"}, {"fieldName": "Scrum Team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "PuppetDB"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "06/Aug/20"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_21709319956_*|*_6_*:*_2_*:*_33979"}], "description": "Comment from the docs feedback form:\n\nIf I could give 0 stars, I would.\nThis is definitely NOT documentation for \"latest\".\n\n\n[https://puppet.com/docs/puppetdb/latest/install_from_packages.html]", "epicLinkSummary": "Improvements to PuppetDB's Documentation", "estimate": "PT0S", "externalId": "51623", "fixedVersions": [], "id": "51623", "issueType": "Improvement", "key": "PDB-4593", "labels": ["docs-pdb", "feedback-form-docs-site", "PuppetDB"], "originalEstimate": "PT0S", "parent": "50600", "parentSummary": "Improvements to PuppetDB's Documentation", "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "status": "Reopened", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "After drop-joins percolates a bit, consider enabling it for a few remaining queries", "timeSpent": "PT0S", "updated": "2022-10-20T14:28:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [{"author": "70121:4084c786-3448-4ef8-8889-3c056e90bb64", "body": "[~accountid:557058:dbc53efe-57a8-4acd-b329-21bc29e30ce8] I made this ticket based on what we discussed earlier for adding some information to the docs about how PDB works behaves with structured facts and regular expressions.\u00a0\n\nI'm not sure where this information should go, but will comb the docs and see if I can find a good spot shortly. Let me know if you have any suggestions.", "created": "2019-11-13T16:26:00.000000"}, {"author": "557058:dbc53efe-57a8-4acd-b329-21bc29e30ce8", "body": "[~accountid:70121:4084c786-3448-4ef8-8889-3c056e90bb64] Here is where I initially looked for info on this: https://puppet.com/docs/puppetdb/latest/api/query/v4/ast.html#regexp-match\n", "created": "2019-11-13T16:28:00.000000"}, {"author": "70121:4084c786-3448-4ef8-8889-3c056e90bb64", "body": "[~accountid:557058:dbc53efe-57a8-4acd-b329-21bc29e30ce8] I moved this to PuppetDB since they manage their own docs, but will still include what we discussed in the release note.", "created": "2019-11-15T14:48:00.000000"}], "components": ["PuppetDB"], "created": "2019-11-13T16:15:00.000000", "creator": "70121:4084c786-3448-4ef8-8889-3c056e90bb64", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@9c4115a"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "Epic Link", "fieldType": "com.pyxis.greenhopper.jira:gh-epic-link", "value": "PDB-4759"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hyk7db:630i96h8ui"}, {"fieldName": "Scrum Team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "PuppetDB"}, {"fieldName": "Story Points", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:float", "value": "1.0"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "13/Nov/19"}], "description": "I realized this ticket is for PuppetDB and not docs.\u00a0\n\nThis came from a bug fix for PE-26106 where there were some interesting PuppetDB behaviors related to regex matching for structured facts. The bug note includes the following language:\u00a0\n\n\"PuppetDB's regular expression matching behaves in surprising ways for structured fact value comparison. For example for the structured fact `os`, a rule that matches `[\"~\", \"os\", \":\"]` will match every node that has the \"os\" structured fact because the regular expression is applied to the JSON encoded version of the fact value.\nThe classifier's classification doesn't use puppetdb for determining classification, and regular expressions in the classifier rules syntax only support direct value comparisons of string types.\"\n\nWe thought it would be helpful to make note of this behavior in the PuppetDB docs, somewhere around here:\u00a0[https://puppet.com/docs/puppetdb/latest/api/query/v4/ast.html#regexp-match]\u00a0\n\nPlease let me know if this is not the right channel for this ticket or if you have any questions.\u00a0", "epicLinkSummary": "Improvements to PuppetDB's Documentation", "estimate": "PT0S", "externalId": "49677", "fixedVersions": [], "id": "49677", "issueType": "Improvement", "key": "PDB-4589", "labels": ["docs-pdb"], "originalEstimate": "PT0S", "parent": "50600", "parentSummary": "Improvements to PuppetDB's Documentation", "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "70121:4084c786-3448-4ef8-8889-3c056e90bb64", "status": "Accepted", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Add PuppetDB behavior for structured facts and regex in docs", "timeSpent": "PT0S", "updated": "2022-03-01T11:51:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [{"author": "5beae128c1d1402b40229c7c", "body": "May no longer be relevant as puppetdb-termini is now in the Puppetlabs repo for Debian Buster.", "created": "2019-11-26T04:26:00.000000"}, {"author": "61af86343618cd006f430854", "body": "Closing due to lack of activity. If you feel this was in error, feel free to add a comment to explain why you would like to re-open the ticket.\n", "created": "2022-01-12T13:03:00.000000"}], "components": ["PuppetDB"], "created": "2019-11-12T07:12:00.000000", "creator": "5beae128c1d1402b40229c7c", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Acceptance Criteria", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textarea", "value": "Instructions should be able to be followed without winging it and assuming that 'puppetdb-termini' should read as 'puppet-terminus-puppetdb'"}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@700559c1"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hzyd0v:"}, {"fieldName": "Scrum Team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "PuppetDB"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "12/Jan/22"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_68449830938_*|*_6_*:*_1_*:*_0"}], "description": "*Problem:*\n\n\u00a0The document at\u00a0[https://puppet.com/docs/puppetdb/latest/connect_puppet_master.html]\u00a0which from it's title is the 'latest' version document refers to installing the 'puppetdb-termini' package. With Puppet Server prepackaged for Debian Buster (Debian 10) - _puppetserver6.7.1-1buster_ - there is no puppet-termini package available. Should this instead reference the puppet-terminus-puppetdb package which is in the repo? Or is there a package missing from the repo? The Ubuntu Bionic repo has a 'puppetdb-termini package' but not a 'puppet-terminus-puppetdb' package, the Debian Buster repo has a 'puppet-terminus-puppetdb' package but not a 'puppetdb-termini' package. It looks like it should be one or the other that get installed, not sure if this is a change in packaging as both bionic and buster install puppetdb 6.7.1-1\n\n*Suggested improvement:*\n\n[https://puppet.com/docs/puppetdb/latest/connect_puppet_master.html]\n\n_Current text :_\nh3. On platforms with packages\n\n[Enable the Puppet Collection repo|https://docs.puppet.com/puppet/6.10/puppet_collections.html]\u00a0and then install the\u00a0{{puppetdb-termini}}\u00a0package:\n\n\u00a0\n\u00a0\n\u00a0\n\n{{$ sudo puppet resource package puppetdb-termini ensure=latest}}.\n\n_Suggested improvement:_\nh3. On platforms with packages\n\n[Enable the Puppet Collection repo|https://docs.puppet.com/puppet/6.10/puppet_collections.html]\u00a0and then install the\u00a0{{*puppet-terminus-puppetdb*}}\u00a0or puppetdb-termini package _*depending on the repository used*_:\n\n\u00a0\n\u00a0\n\u00a0\n\n{{$ sudo puppet resource package *[puppet-terminus-puppetdb|puppetdb-termini]*\u00a0ensure=latest}}\n\n*Summary:*\n\n\u00a0Either this is a change in packaging (implied a change in documentation for 'latest' or it's an error in packaging for Debian Buster.", "environment": "**Debian Buster\u00a0**\u00a0system\u00a0**\u00a0installed with puppet / puppetdb from the repo pointed to by https://apt.puppetlabs.com/puppet6-release-buster.deb*.*\u00a0", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "50071", "fixedVersions": [], "id": "50071", "issueType": "Bug", "key": "PDB-4587", "labels": ["docs"], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "status": "Accepted", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Always look for include_facts_expiration in the engine", "timeSpent": "PT0S", "updated": "2022-02-10T07:44:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2019-11-11T15:07:00.000000", "creator": "557058:4786f794-5167-4041-b3c0-deb1e8ba3438", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@6f958282"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "Epic Link", "fieldType": "com.pyxis.greenhopper.jira:gh-epic-link", "value": "PDB-4580"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hzycfj:"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_2309_*|*_5_*:*_1_*:*_0_*|*_10006_*:*_1_*:*_4081004"}], "description": "(Initial planned release date: 2019-11-19)\n\nUpdate winston to make these tickets more accurate for next time.\n", "duedate": "2019-11-20T00:00:00.000000", "epicLinkSummary": "PuppetDB 6.7.3 2019-11-19 Release", "estimate": "PT0S", "externalId": "49037", "fixedVersions": [], "id": "49037", "issueType": "Task", "key": "PDB-4585", "labels": [], "originalEstimate": "PT0S", "parent": "50586", "parentSummary": "PuppetDB 6.7.3 2019-11-19 Release", "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:0a2bfc9c-1912-49b1-9776-665ef20c8769", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Docs feedback for \"Connecting Puppet masters to PuppetDB\"", "timeSpent": "PT0S", "updated": "2022-03-03T06:23:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [{"attacher": "70121:64260ba9-b0ac-48da-a645-42085c6d8d09", "created": "2019-10-17T02:33:00.000000", "name": "clojure-3369221277167781123.edn", "uri": "https://puppet.atlassian.net/rest/api/3/attachment/content/14162"}, {"attacher": "70121:64260ba9-b0ac-48da-a645-42085c6d8d09", "created": "2019-10-17T02:34:00.000000", "name": "puppetdb-all.txt", "uri": "https://puppet.atlassian.net/rest/api/3/attachment/content/14014"}, {"attacher": "70121:64260ba9-b0ac-48da-a645-42085c6d8d09", "created": "2019-10-17T02:34:00.000000", "name": "puppetdb_6.7.1.log", "uri": "https://puppet.atlassian.net/rest/api/3/attachment/content/13991"}], "comments": [{"author": "70121:64260ba9-b0ac-48da-a645-42085c6d8d09", "body": "v6.7.0 looks good as far as I see. So I'd say it's working ok with Azure Database for PostgreSQL JFYI", "created": "2019-10-17T03:48:00.000000"}], "components": ["PuppetDB"], "created": "2019-10-17T02:25:00.000000", "creator": "70121:64260ba9-b0ac-48da-a645-42085c6d8d09", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@1a74cbf6"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Master OS", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Ubuntu 16.04 (amd64)"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hykawv:00000ikoj0009"}], "description": "I'm trying to install fresh PuppetDB to use with Azure Database for PostgreSQL 9.6 instance (PostgreSQL as a service). While PuppetDB 6.7.0 looks good (can connect to DB at least), v6.7.1 fails with following message:\n{code:java}\nOct 17 07:06:50 puppetp1 puppetdb[3065]: Execution error (IOException) at org.postgresql.core.UTF8Encoding/decode (UTF8Encoding.java:102).\nOct 17 07:06:50 puppetp1 puppetdb[3065]: Illegal UTF-8 sequence: initial byte is 10xxxxxx: 160\n{code}\nDatabase is created in UTF-8 encoding with en-SG collation:\n{code:java}\n\u00a0puppetdb=> \\l puppetdb\n List of databases\n Name | Owner | Encoding | Collate | Ctype | Access privileges\n----------+----------+----------+---------+-------+-----------------------\n puppetdb | puppetdb | UTF8 | en-SG | en-SG | =T/puppetdb +\n | | | | | puppetdb=CTc/puppetdb\n{code}\nI did some investigation and found it fails on 'show all' query which was introduced to check database settings in v6.7.1. I can see 'show all' query results in psql output without any issue though.\n\nI'll attach full trace and 'show all' results to this ticket a bit later. Will check is 6.7.0 really working too.", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "52739", "fixedVersions": [], "id": "52739", "issueType": "Bug", "key": "PDB-4553", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "70121:64260ba9-b0ac-48da-a645-42085c6d8d09", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "PuppetDB 6.7.1 doesn't work with Azure Database for PostgreSQL", "timeSpent": "PT0S", "updated": "2022-02-10T07:49:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2019-10-16T15:46:00.000000", "creator": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@1216b9c3"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hzxqrb:"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_6121_*|*_3_*:*_1_*:*_1031292526_*|*_10009_*:*_1_*:*_9187773533_*|*_6_*:*_1_*:*_0_*|*_10006_*:*_1_*:*_70646978"}], "description": "Add a check to pe-pdb ha-sync to prevent it from syncing with a pdb that's newer than itself. This is a guard against upgrades that change the format of the data used to decide what to sync. By only syncing with pdbs of the same version we can avoid issues where one pdb is upgraded before another in a way that causes sync to pull duplicate data. ", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "50570", "fixedVersions": ["PDB 6.9.0"], "id": "50570", "issueType": "Improvement", "key": "PDB-4552", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:b2bcb0d0-9097-47f9-b317-4b1eef66aedb", "resolution": "Fixed", "resolutionDate": "2019-10-04T15:23:00.000000", "status": "Resolved", "statusCategory": "Done", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "Fresh install of puppetdb will not start ERROR: invalid byte sequence for encoding \"UTF8\"", "timeSpent": "PT0S", "updated": "2019-10-22T12:09:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2019-09-17T11:00:00.000000", "creator": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@57c01ef2"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "CS Priority", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Reviewed"}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hym02v:"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "25/Sep/19"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_19859_*|*_10007_*:*_1_*:*_27141316_*|*_3_*:*_1_*:*_1122247145_*|*_5_*:*_1_*:*_0_*|*_10006_*:*_1_*:*_1895723955_*|*_10005_*:*_1_*:*_41850"}], "description": "Observed while migrating a large db through resource-events-pk, though no reason to suspect the migration itself was relevant. After C-c there was a traceback, and it never returned to a prompt. Subsequent C-c presses had no effect.\n\nCode was based on this:\n\n commit 2e76681386bf382997545eaeb78be0cbcb53b4be\n Author: Zachary Kent \n Date: Thu Sep 12 10:02:23 2019 -0700\n\n (maint) Bump clj-parent to 4.2.0\n\nwith a few changes. I don't think they were likely to be relevant, but I'll try to re-test without them and if that resolves it, delete this bug.\n\n{code}^C2019-09-17 09:41:36,155 INFO [Thread-1] [p.t.internal] Shutting down due to JVM shutdown hook.\n2019-09-17 09:41:36,159 INFO [PuppetDB migration pool closer] [c.z.h.HikariDataSource] PDBMigrationsPool - Shutdown initiated...\n2019-09-17 09:41:36,178 INFO [Thread-1] [p.t.internal] Beginning shutdown sequence\n2019-09-17 09:41:36,239 INFO [PuppetDB migration pool closer] [c.z.h.HikariDataSource] PDBMigrationsPool - Shutdown completed.\n2019-09-17 09:41:36,261 WARN [async-dispatch-2] [c.z.h.p.ProxyConnection] PDBMigrationsPool - Connection org.postgresql.jdbc.PgConnection@8483bd7 marked as broken because of SQLSTATE(08003), ErrorCode(0)\norg.postgresql.util.PSQLException: This connection has been closed.\n at org.postgresql.jdbc.PgConnection.checkClosed(PgConnection.java:767)\n at org.postgresql.jdbc.PgConnection.getHoldability(PgConnection.java:1588)\n at org.postgresql.jdbc.PgConnection.prepareStatement(PgConnection.java:1699)\n at org.postgresql.jdbc.PgConnection.prepareStatement(PgConnection.java:1675)\n at com.zaxxer.hikari.pool.ProxyConnection.prepareStatement(ProxyConnection.java:325)\n at com.zaxxer.hikari.pool.HikariProxyConnection.prepareStatement(HikariProxyConnection.java)\n at clojure.java.jdbc$prepare_statement$fn__21606.invoke(jdbc.clj:624)\n at clojure.java.jdbc$prepare_statement.invokeStatic(jdbc.clj:617)\n at clojure.java.jdbc$prepare_statement.invoke(jdbc.clj:591)\n at clojure.java.jdbc$db_do_prepared_return_keys.invokeStatic(jdbc.clj:983)\n at clojure.java.jdbc$db_do_prepared_return_keys.invoke(jdbc.clj:963)\n at clojure.java.jdbc$multi_insert_helper$per_statement__21778.invoke(jdbc.clj:1449)\n at clojure.core$mapv$fn__8445.invoke(core.clj:6912)\n at clojure.core.protocols$fn__8159.invokeStatic(protocols.clj:168)\n at clojure.core.protocols$fn__8159.invoke(protocols.clj:124)\n at clojure.core.protocols$fn__8114$G__8109__8123.invoke(protocols.clj:19)\n at clojure.core.protocols$seq_reduce.invokeStatic(protocols.clj:31)\n at clojure.core.protocols$fn__8146.invokeStatic(protocols.clj:75)\n at clojure.core.protocols$fn__8146.invoke(protocols.clj:75)\n at clojure.core.protocols$fn__8088$G__8083__8101.invoke(protocols.clj:13)\n at clojure.core$reduce.invokeStatic(core.clj:6828)\n at clojure.core$mapv.invokeStatic(core.clj:6903)\n at clojure.core$mapv.invoke(core.clj:6903)\n at clojure.java.jdbc$multi_insert_helper.invokeStatic(jdbc.clj:1465)\n at clojure.java.jdbc$multi_insert_helper.invoke(jdbc.clj:1442)\n at clojure.java.jdbc$insert_helper$fn__21782.invoke(jdbc.clj:1472)\n at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:814)\n at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741)\n at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:754)\n at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741)\n at clojure.java.jdbc$insert_helper.invokeStatic(jdbc.clj:1472)\n at clojure.java.jdbc$insert_helper.invoke(jdbc.clj:1467)\n at clojure.java.jdbc$insert_rows_BANG_.invokeStatic(jdbc.clj:1530)\n at clojure.java.jdbc$insert_rows_BANG_.invoke(jdbc.clj:1516)\n at clojure.java.jdbc$insert_multi_BANG_.invokeStatic(jdbc.clj:1589)\n at clojure.java.jdbc$insert_multi_BANG_.invoke(jdbc.clj:1568)\n at puppetlabs.puppetdb.jdbc$insert_multi_BANG_.invokeStatic(jdbc.clj:173)\n at puppetlabs.puppetdb.jdbc$insert_multi_BANG_.invoke(jdbc.clj:166)\n at puppetlabs.puppetdb.scf.migrate$add_resource_events_pk$fn__35273$fn__35275.invoke(migrate.clj:1577)\n at clojure.core.protocols$fn__8159.invokeStatic(protocols.clj:168)\n at clojure.core.protocols$fn__8159.invoke(protocols.clj:124)\n at clojure.core.protocols$fn__8114$G__8109__8123.invoke(protocols.clj:19)\n at clojure.core.protocols$seq_reduce.invokeStatic(protocols.clj:31)\n at clojure.core.protocols$fn__8146.invokeStatic(protocols.clj:75)\n at clojure.core.protocols$fn__8146.invoke(protocols.clj:75)\n at clojure.core.protocols$fn__8088$G__8083__8101.invoke(protocols.clj:13)\n at clojure.core$reduce.invokeStatic(core.clj:6828)\n at clojure.core$reduce.invoke(core.clj:6810)\n at puppetlabs.puppetdb.scf.migrate$add_resource_events_pk$fn__35273.invoke(migrate.clj:1567)\n at puppetlabs.puppetdb.jdbc$call_with_query_rows$fn__22062.invoke(jdbc.clj:265)\n at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:814)\n at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741)\n at puppetlabs.puppetdb.jdbc$call_with_query_rows.invokeStatic(jdbc.clj:258)\n at puppetlabs.puppetdb.jdbc$call_with_query_rows.invoke(jdbc.clj:245)\n at puppetlabs.puppetdb.jdbc$call_with_query_rows.invokeStatic(jdbc.clj:254)\n at puppetlabs.puppetdb.jdbc$call_with_query_rows.invoke(jdbc.clj:245)\n at puppetlabs.puppetdb.scf.migrate$add_resource_events_pk.invokeStatic(migrate.clj:1561)\n at puppetlabs.puppetdb.scf.migrate$add_resource_events_pk.invoke(migrate.clj:1525)\n at puppetlabs.puppetdb.scf.migrate$migrate_BANG_$fn__35318$fn__35320$fn__35324.invoke(migrate.clj:1842)\n at puppetlabs.puppetdb.scf.migrate$sql_or_die.invokeStatic(migrate.clj:1784)\n at puppetlabs.puppetdb.scf.migrate$sql_or_die.invoke(migrate.clj:1775)\n at puppetlabs.puppetdb.scf.migrate$migrate_BANG_$fn__35318$fn__35320.invoke(migrate.clj:1842)\n at clojure.core$map$fn__5866.invoke(core.clj:2755)\n at clojure.lang.LazySeq.sval(LazySeq.java:42)\n at clojure.lang.LazySeq.seq(LazySeq.java:51)\n at clojure.lang.RT.seq(RT.java:535)\n at clojure.core$seq__5402.invokeStatic(core.clj:137)\n at clojure.core$filter$fn__5893.invoke(core.clj:2809)\n at clojure.lang.LazySeq.sval(LazySeq.java:42)\n at clojure.lang.LazySeq.seq(LazySeq.java:58)\n at clojure.lang.RT.seq(RT.java:535)\n at clojure.core$seq__5402.invokeStatic(core.clj:137)\n at clojure.core$map$fn__5866.invoke(core.clj:2746)\n at clojure.lang.LazySeq.sval(LazySeq.java:42)\n at clojure.lang.LazySeq.seq(LazySeq.java:51)\n at clojure.lang.Cons.next(Cons.java:39)\n at clojure.lang.RT.boundedLength(RT.java:1792)\n at clojure.lang.RestFn.applyTo(RestFn.java:130)\n at clojure.core$apply.invokeStatic(core.clj:667)\n at clojure.core$apply.invoke(core.clj:660)\n at puppetlabs.puppetdb.scf.migrate$migrate_BANG_$fn__35318.invoke(migrate.clj:1849)\n at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:771)\n at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741)\n at puppetlabs.puppetdb.scf.migrate$migrate_BANG_.invokeStatic(migrate.clj:1837)\n at puppetlabs.puppetdb.scf.migrate$migrate_BANG_.invoke(migrate.clj:1808)\n at puppetlabs.puppetdb.cli.services$initialize_schema.invokeStatic(services.clj:331)\n at puppetlabs.puppetdb.cli.services$initialize_schema.invoke(services.clj:316)\n at puppetlabs.puppetdb.cli.services$init_with_db$fn__35560.invoke(services.clj:363)\n at puppetlabs.puppetdb.cli.services$init_with_db.invokeStatic(services.clj:362)\n at puppetlabs.puppetdb.cli.services$init_with_db.invoke(services.clj:335)\n at puppetlabs.puppetdb.cli.services$start_puppetdb.invokeStatic(services.clj:458)\n at puppetlabs.puppetdb.cli.services$start_puppetdb.invoke(services.clj:432)\n at puppetlabs.puppetdb.cli.services$reify__35680$service_fnk__19152__auto___positional$reify__35691.start(services.clj:568)\n at puppetlabs.trapperkeeper.services$fn__18989$G__18970__18992.invoke(services.clj:9)\n at puppetlabs.trapperkeeper.services$fn__18989$G__18969__18996.invoke(services.clj:9)\n at puppetlabs.trapperkeeper.internal$fn__19484$run_lifecycle_fn_BANG___19491$fn__19492.invoke(internal.clj:196)\n at puppetlabs.trapperkeeper.internal$fn__19484$run_lifecycle_fn_BANG___19491.invoke(internal.clj:179)\n at puppetlabs.trapperkeeper.internal$fn__19513$run_lifecycle_fns__19518$fn__19519.invoke(internal.clj:229)\n at puppetlabs.trapperkeeper.internal$fn__19513$run_lifecycle_fns__19518.invoke(internal.clj:206)\n at puppetlabs.trapperkeeper.internal$fn__20084$build_app_STAR___20093$fn$reify__20105.start(internal.clj:584)\n at puppetlabs.trapperkeeper.internal$fn__20132$boot_services_for_app_STAR__STAR___20139$fn__20140$fn__20142.invoke(internal.clj:610)\n at puppetlabs.trapperkeeper.internal$fn__20132$boot_services_for_app_STAR__STAR___20139$fn__20140.invoke(internal.clj:608)\n at puppetlabs.trapperkeeper.internal$fn__20132$boot_services_for_app_STAR__STAR___20139.invoke(internal.clj:602)\n at clojure.core$partial$fn__5841.invoke(core.clj:2630)\n at puppetlabs.trapperkeeper.internal$fn__19558$initialize_lifecycle_worker__19569$fn__19570$fn__19720$state_machine__12292__auto____19745$fn__19748.invoke(internal.clj:249)\n at puppetlabs.trapperkeeper.internal$fn__19558$initialize_lifecycle_worker__19569$fn__19570$fn__19720$state_machine__12292__auto____19745.invoke(internal.clj:249)\n at clojure.core.async.impl.ioc_macros$run_state_machine.invokeStatic(ioc_macros.clj:973)\n at clojure.core.async.impl.ioc_macros$run_state_machine.invoke(ioc_macros.clj:972)\n at clojure.core.async.impl.ioc_macros$run_state_machine_wrapped.invokeStatic(ioc_macros.clj:977)\n at clojure.core.async.impl.ioc_macros$run_state_machine_wrapped.invoke(ioc_macros.clj:975)\n at clojure.core.async$ioc_alts_BANG_$fn__12507.invoke(async.clj:384)\n at clojure.core.async$do_alts$fn__12447$fn__12450.invoke(async.clj:253)\n at clojure.core.async.impl.channels.ManyToManyChannel$fn__7111$fn__7112.invoke(channels.clj:95)\n at clojure.lang.AFn.run(AFn.java:22)\n at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n at java.base/java.lang.Thread.run(Thread.java:834)\n2019-09-17 09:41:36,266 ERROR [async-dispatch-2] [p.p.s.migrate] Caught SQLException during migration\njava.sql.SQLException: Connection is closed\n at com.zaxxer.hikari.pool.ProxyConnection$ClosedConnection.lambda$getClosedConnection$0(ProxyConnection.java:490)\n at com.sun.proxy.$Proxy11.prepareStatement(Unknown Source)\n at com.zaxxer.hikari.pool.ProxyConnection.prepareStatement(ProxyConnection.java:318)\n at com.zaxxer.hikari.pool.HikariProxyConnection.prepareStatement(HikariProxyConnection.java)\n at clojure.java.jdbc$prepare_statement$fn__21606.invoke(jdbc.clj:627)\n at clojure.java.jdbc$prepare_statement.invokeStatic(jdbc.clj:617)\n at clojure.java.jdbc$prepare_statement.invoke(jdbc.clj:591)\n at clojure.java.jdbc$db_do_prepared_return_keys.invokeStatic(jdbc.clj:983)\n at clojure.java.jdbc$db_do_prepared_return_keys.invoke(jdbc.clj:963)\n at clojure.java.jdbc$multi_insert_helper$per_statement__21778.invoke(jdbc.clj:1449)\n at clojure.core$mapv$fn__8445.invoke(core.clj:6912)\n at clojure.core.protocols$fn__8159.invokeStatic(protocols.clj:168)\n at clojure.core.protocols$fn__8159.invoke(protocols.clj:124)\n at clojure.core.protocols$fn__8114$G__8109__8123.invoke(protocols.clj:19)\n at clojure.core.protocols$seq_reduce.invokeStatic(protocols.clj:31)\n at clojure.core.protocols$fn__8146.invokeStatic(protocols.clj:75)\n at clojure.core.protocols$fn__8146.invoke(protocols.clj:75)\n at clojure.core.protocols$fn__8088$G__8083__8101.invoke(protocols.clj:13)\n at clojure.core$reduce.invokeStatic(core.clj:6828)\n at clojure.core$mapv.invokeStatic(core.clj:6903)\n at clojure.core$mapv.invoke(core.clj:6903)\n at clojure.java.jdbc$multi_insert_helper.invokeStatic(jdbc.clj:1465)\n at clojure.java.jdbc$multi_insert_helper.invoke(jdbc.clj:1442)\n at clojure.java.jdbc$insert_helper$fn__21782.invoke(jdbc.clj:1472)\n at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:814)\n at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741)\n at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:754)\n at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741)\n at clojure.java.jdbc$insert_helper.invokeStatic(jdbc.clj:1472)\n at clojure.java.jdbc$insert_helper.invoke(jdbc.clj:1467)\n at clojure.java.jdbc$insert_rows_BANG_.invokeStatic(jdbc.clj:1530)\n at clojure.java.jdbc$insert_rows_BANG_.invoke(jdbc.clj:1516)\n at clojure.java.jdbc$insert_multi_BANG_.invokeStatic(jdbc.clj:1589)\n at clojure.java.jdbc$insert_multi_BANG_.invoke(jdbc.clj:1568)\n at puppetlabs.puppetdb.jdbc$insert_multi_BANG_.invokeStatic(jdbc.clj:173)\n at puppetlabs.puppetdb.jdbc$insert_multi_BANG_.invoke(jdbc.clj:166)\n at puppetlabs.puppetdb.scf.migrate$add_resource_events_pk$fn__35273$fn__35275.invoke(migrate.clj:1577)\n at clojure.core.protocols$fn__8159.invokeStatic(protocols.clj:168)\n at clojure.core.protocols$fn__8159.invoke(protocols.clj:124)\n at clojure.core.protocols$fn__8114$G__8109__8123.invoke(protocols.clj:19)\n at clojure.core.protocols$seq_reduce.invokeStatic(protocols.clj:31)\n at clojure.core.protocols$fn__8146.invokeStatic(protocols.clj:75)\n at clojure.core.protocols$fn__8146.invoke(protocols.clj:75)\n at clojure.core.protocols$fn__8088$G__8083__8101.invoke(protocols.clj:13)\n at clojure.core$reduce.invokeStatic(core.clj:6828)\n at clojure.core$reduce.invoke(core.clj:6810)\n at puppetlabs.puppetdb.scf.migrate$add_resource_events_pk$fn__35273.invoke(migrate.clj:1567)\n at puppetlabs.puppetdb.jdbc$call_with_query_rows$fn__22062.invoke(jdbc.clj:265)\n at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:814)\n at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741)\n at puppetlabs.puppetdb.jdbc$call_with_query_rows.invokeStatic(jdbc.clj:258)\n at puppetlabs.puppetdb.jdbc$call_with_query_rows.invoke(jdbc.clj:245)\n at puppetlabs.puppetdb.jdbc$call_with_query_rows.invokeStatic(jdbc.clj:254)\n at puppetlabs.puppetdb.jdbc$call_with_query_rows.invoke(jdbc.clj:245)\n at puppetlabs.puppetdb.scf.migrate$add_resource_events_pk.invokeStatic(migrate.clj:1561)\n at puppetlabs.puppetdb.scf.migrate$add_resource_events_pk.invoke(migrate.clj:1525)\n at puppetlabs.puppetdb.scf.migrate$migrate_BANG_$fn__35318$fn__35320$fn__35324.invoke(migrate.clj:1842)\n at puppetlabs.puppetdb.scf.migrate$sql_or_die.invokeStatic(migrate.clj:1784)\n at puppetlabs.puppetdb.scf.migrate$sql_or_die.invoke(migrate.clj:1775)\n at puppetlabs.puppetdb.scf.migrate$migrate_BANG_$fn__35318$fn__35320.invoke(migrate.clj:1842)\n at clojure.core$map$fn__5866.invoke(core.clj:2755)\n at clojure.lang.LazySeq.sval(LazySeq.java:42)\n at clojure.lang.LazySeq.seq(LazySeq.java:51)\n at clojure.lang.RT.seq(RT.java:535)\n at clojure.core$seq__5402.invokeStatic(core.clj:137)\n at clojure.core$filter$fn__5893.invoke(core.clj:2809)\n at clojure.lang.LazySeq.sval(LazySeq.java:42)\n at clojure.lang.LazySeq.seq(LazySeq.java:58)\n at clojure.lang.RT.seq(RT.java:535)\n at clojure.core$seq__5402.invokeStatic(core.clj:137)\n at clojure.core$map$fn__5866.invoke(core.clj:2746)\n at clojure.lang.LazySeq.sval(LazySeq.java:42)\n at clojure.lang.LazySeq.seq(LazySeq.java:51)\n at clojure.lang.Cons.next(Cons.java:39)\n at clojure.lang.RT.boundedLength(RT.java:1792)\n at clojure.lang.RestFn.applyTo(RestFn.java:130)\n at clojure.core$apply.invokeStatic(core.clj:667)\n at clojure.core$apply.invoke(core.clj:660)\n at puppetlabs.puppetdb.scf.migrate$migrate_BANG_$fn__35318.invoke(migrate.clj:1849)\n at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:771)\n at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741)\n at puppetlabs.puppetdb.scf.migrate$migrate_BANG_.invokeStatic(migrate.clj:1837)\n at puppetlabs.puppetdb.scf.migrate$migrate_BANG_.invoke(migrate.clj:1808)\n at puppetlabs.puppetdb.cli.services$initialize_schema.invokeStatic(services.clj:331)\n at puppetlabs.puppetdb.cli.services$initialize_schema.invoke(services.clj:316)\n at puppetlabs.puppetdb.cli.services$init_with_db$fn__35560.invoke(services.clj:363)\n at puppetlabs.puppetdb.cli.services$init_with_db.invokeStatic(services.clj:362)\n at puppetlabs.puppetdb.cli.services$init_with_db.invoke(services.clj:335)\n at puppetlabs.puppetdb.cli.services$start_puppetdb.invokeStatic(services.clj:458)\n at puppetlabs.puppetdb.cli.services$start_puppetdb.invoke(services.clj:432)\n at puppetlabs.puppetdb.cli.services$reify__35680$service_fnk__19152__auto___positional$reify__35691.start(services.clj:568)\n at puppetlabs.trapperkeeper.services$fn__18989$G__18970__18992.invoke(services.clj:9)\n at puppetlabs.trapperkeeper.services$fn__18989$G__18969__18996.invoke(services.clj:9)\n at puppetlabs.trapperkeeper.internal$fn__19484$run_lifecycle_fn_BANG___19491$fn__19492.invoke(internal.clj:196)\n at puppetlabs.trapperkeeper.internal$fn__19484$run_lifecycle_fn_BANG___19491.invoke(internal.clj:179)\n at puppetlabs.trapperkeeper.internal$fn__19513$run_lifecycle_fns__19518$fn__19519.invoke(internal.clj:229)\n at puppetlabs.trapperkeeper.internal$fn__19513$run_lifecycle_fns__19518.invoke(internal.clj:206)\n at puppetlabs.trapperkeeper.internal$fn__20084$build_app_STAR___20093$fn$reify__20105.start(internal.clj:584)\n at puppetlabs.trapperkeeper.internal$fn__20132$boot_services_for_app_STAR__STAR___20139$fn__20140$fn__20142.invoke(internal.clj:610)\n at puppetlabs.trapperkeeper.internal$fn__20132$boot_services_for_app_STAR__STAR___20139$fn__20140.invoke(internal.clj:608)\n at puppetlabs.trapperkeeper.internal$fn__20132$boot_services_for_app_STAR__STAR___20139.invoke(internal.clj:602)\n at clojure.core$partial$fn__5841.invoke(core.clj:2630)\n at puppetlabs.trapperkeeper.internal$fn__19558$initialize_lifecycle_worker__19569$fn__19570$fn__19720$state_machine__12292__auto____19745$fn__19748.invoke(internal.clj:249)\n at puppetlabs.trapperkeeper.internal$fn__19558$initialize_lifecycle_worker__19569$fn__19570$fn__19720$state_machine__12292__auto____19745.invoke(internal.clj:249)\n at clojure.core.async.impl.ioc_macros$run_state_machine.invokeStatic(ioc_macros.clj:973)\n at clojure.core.async.impl.ioc_macros$run_state_machine.invoke(ioc_macros.clj:972)\n at clojure.core.async.impl.ioc_macros$run_state_machine_wrapped.invokeStatic(ioc_macros.clj:977)\n at clojure.core.async.impl.ioc_macros$run_state_machine_wrapped.invoke(ioc_macros.clj:975)\n at clojure.core.async$ioc_alts_BANG_$fn__12507.invoke(async.clj:384)\n at clojure.core.async$do_alts$fn__12447$fn__12450.invoke(async.clj:253)\n at clojure.core.async.impl.channels.ManyToManyChannel$fn__7111$fn__7112.invoke(channels.clj:95)\n at clojure.lang.AFn.run(AFn.java:22)\n at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n at java.base/java.lang.Thread.run(Thread.java:834)\n^C^C\n^C^C^C^C^Z\n[2]+ Stopped\n{code}", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "51128", "fixedVersions": ["PDB 5.2.11", "PDB 6.3.6", "PDB 6.7.2"], "id": "51128", "issueType": "Bug", "key": "PDB-4506", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:745e5b4d-58ed-48ed-8daa-afe8b66453a1", "status": "Open", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "PuppetDB docs: feedback", "timeSpent": "PT0S", "updated": "2022-03-03T06:23:00.000000", "votes": "1", "watchers": []}, {"affectedVersions": [], "assignee": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2019-08-16T16:10:00.000000", "creator": "557058:1b9bde12-f0a1-4355-ab73-7fc4ec69ba79", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@514ddf5c"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "Epic Link", "fieldType": "com.pyxis.greenhopper.jira:gh-epic-link", "value": "PDB-4759"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hzwgof:"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "Scrum Team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "PuppetDB"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_30760956706_*|*_10007_*:*_1_*:*_1272179031_*|*_5_*:*_1_*:*_0"}], "description": "Two docs issues I wanted to flag for fixes when you get the chance:\n\nOne: https://puppet.com/docs/puppetdb/6.4/index.html#version-note says that this \"manual\" is for PuppetDB 5. The minor issue is use of the word \"manual\" where it should be \"documentation,\" but more importantly, this should be for PuppetDB 6 in all 6.x versions of this doc.\n\nNext: https://puppet.com/docs/puppetdb/6.4/install_via_module.html , there is a note about PE 3.0. That seems pretty safe to remove in PuppetDB 6.x docs, at least.", "epicLinkSummary": "Improvements to PuppetDB's Documentation", "estimate": "PT0S", "externalId": "51126", "fixedVersions": ["PDB n/a"], "id": "51126", "issueType": "Task", "key": "PDB-4483", "labels": ["docs-pdb"], "originalEstimate": "PT0S", "parent": "50600", "parentSummary": "Improvements to PuppetDB's Documentation", "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:02b35bcd-4280-4d46-ab70-339e39dd45e9", "status": "Accepted", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "PuppetDB Log Directory Permissions are Incorrect", "timeSpent": "PT0S", "updated": "2022-03-03T06:16:00.000000", "votes": "1", "watchers": []}, {"affectedVersions": [], "assignee": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "attachments": [], "comments": [{"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "Done in PDB-4372", "created": "2019-08-06T15:14:00.000000"}], "components": ["PuppetDB"], "created": "2019-07-26T11:02:00.000000", "creator": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@5d207ab5"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "Epic Link", "fieldType": "com.pyxis.greenhopper.jira:gh-epic-link", "value": "PDB-4369"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hykdyf:"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "06/Aug/19"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_7925_*|*_3_*:*_1_*:*_75050530_*|*_6_*:*_1_*:*_0_*|*_10006_*:*_1_*:*_890509131"}], "description": "Add tests (likely to puppetdb.command-test) that ensure that the command endpoint processes replace catalog inputs correctly.", "epicLinkSummary": "Hiera IA: Store \"inputs\" for catalogs and add query for certnames that might be affected by an input", "estimate": "PT0S", "externalId": "52131", "fixedVersions": [], "id": "52131", "issueType": "Improvement", "key": "PDB-4461", "labels": [], "originalEstimate": "PT0S", "parent": "48612", "parentSummary": "Hiera IA: Store \"inputs\" for catalogs and add query for certnames that might be affected by an input", "priority": "Normal", "projectDescription": "

PuppetDB Project

'\n\t19: from /opt/puppetlabs/bin/puppet-query:23:in `load'\n\t18: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/puppetdb_cli-2.0.1/exe/puppet-query:7:in `'\n\t17: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/puppetdb_cli-2.0.1/lib/puppetdb_cli.rb:13:in `run'\n\t16: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/cri-2.15.10/lib/cri/command.rb:314:in `run'\n\t15: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/cri-2.15.10/lib/cri/command.rb:296:in `run'\n\t14: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/cri-2.15.10/lib/cri/command.rb:360:in `run_this'\n\t13: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/puppetdb_cli-2.0.1/lib/puppetdb_cli/query.rb:30:in `block (2 levels) in '\n\t12: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/puppetdb_cli-2.0.1/lib/puppetdb_cli/utils.rb:43:in `send_query'\n\t11: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/pl-puppetdb-ruby-2.0.3/lib/puppetdb/client.rb:103:in `request'\n\t10: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/pl-puppetdb-ruby-2.0.3/lib/puppetdb/client.rb:103:in `each'\n\t 9: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/pl-puppetdb-ruby-2.0.3/lib/puppetdb/client.rb:105:in `block in request'\n\t 8: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/httparty-0.18.1/lib/httparty.rb:508:in `get'\n\t 7: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/httparty-0.18.1/lib/httparty.rb:594:in `perform_request'\n\t 6: from /opt/puppetlabs/puppet/lib/ruby/gems/2.5.0/gems/httparty-0.18.1/lib/httparty/request.rb:145:in `perform'\n\t 5: from /opt/puppetlabs/puppet/lib/ruby/2.5.0/net/http.rb:1458:in `request'\n\t 4: from /opt/puppetlabs/puppet/lib/ruby/2.5.0/net/http.rb:909:in `start'\n\t 3: from /opt/puppetlabs/puppet/lib/ruby/2.5.0/net/http.rb:920:in `do_start'\n\t 2: from /opt/puppetlabs/puppet/lib/ruby/2.5.0/net/http.rb:985:in `connect'\n\t 1: from /opt/puppetlabs/puppet/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect'\n/opt/puppetlabs/puppet/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock': SSL_connect returned=1 errno=0 state=error: certificate verify failed (unspecified certificate verification error) (OpenSSL::SSL::SSLError)\n{noformat}\n", "created": "2020-06-22T15:43:00.000000"}, {"author": "6243aef65f63fd0069b1a617", "body": "Just an FYI- in my case, I was using localhost (since the cli is installed on the puppetdb server) in the server_urls option. Changing it to the FQDN of the machine solved the issue for me. In my case, I'm guessing that the server_urls have to match the subject of the certificate offered by puppetdb on its initial SSL negotiation.", "created": "2020-06-22T15:49:00.000000"}], "components": ["PuppetDB"], "created": "2019-06-27T17:31:00.000000", "creator": "6243b143f3824d006a579629", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@4f9d0b43"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Master OS", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "CentOS 7"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hzvfjz:"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "22/Jun/20"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_81548835637_*|*_6_*:*_1_*:*_0"}], "description": "Following the installation/configuration instructions at\u00a0[https://puppet.com/docs/puppetdb/6.3/pdb_client_tools.html], I have been unable to perform a simple test query.\u00a0 These fail like:\n\n~~~\n\n$ sudo puppet query \"nodes [ certname ] { limit 1 }\"\n Traceback (most recent call last):\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a020: from /usr/local/bin/puppet-query:23:in `

'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a019: from /usr/local/bin/puppet-query:23:in `load'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a018: from /usr/local/share/gems/gems/puppetdb_cli-2.0.0/exe/puppet-query:7:in `'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a017: from /usr/local/share/gems/gems/puppetdb_cli-2.0.0/lib/puppetdb_cli.rb:13:in `run'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a016: from /usr/local/share/gems/gems/cri-2.15.9/lib/cri/command.rb:314:in `run'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a015: from /usr/local/share/gems/gems/cri-2.15.9/lib/cri/command.rb:296:in `run'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a014: from /usr/local/share/gems/gems/cri-2.15.9/lib/cri/command.rb:360:in `run_this'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a013: from /usr/local/share/gems/gems/puppetdb_cli-2.0.0/lib/puppetdb_cli/query.rb:34:in `block (2 levels) in '\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a012: from /usr/local/share/gems/gems/puppetdb_cli-2.0.0/lib/puppetdb_cli/utils.rb:41:in `send_query'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a011: from /usr/local/share/gems/gems/pl-puppetdb-ruby-2.0.2/lib/puppetdb/client.rb:103:in `request'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a010: from /usr/local/share/gems/gems/pl-puppetdb-ruby-2.0.2/lib/puppetdb/client.rb:103:in `each'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a09: from /usr/local/share/gems/gems/pl-puppetdb-ruby-2.0.2/lib/puppetdb/client.rb:105:in `block in request'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a08: from /usr/local/share/gems/gems/httparty-0.17.0/lib/httparty.rb:507:in `get'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a07: from /usr/local/share/gems/gems/httparty-0.17.0/lib/httparty.rb:593:in `perform_request'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a06: from /usr/local/share/gems/gems/httparty-0.17.0/lib/httparty/request.rb:145:in `perform'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a05: from /usr/share/ruby/net/http.rb:1470:in `request'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a04: from /usr/share/ruby/net/http.rb:919:in `start'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a03: from /usr/share/ruby/net/http.rb:930:in `do_start'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a02: from /usr/share/ruby/net/http.rb:996:in `connect'\n \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a01: from /usr/share/ruby/net/protocol.rb:44:in `ssl_socket_connect'\n /usr/share/ruby/net/protocol.rb:44:in `connect_nonblock': SSL_connect returned=1 errno=0 state=error: certificate verify failed (unspecified certificate verification error) (OpenSSL::SSL::SSLError)\n\n~~~\n\nMy CLI config (/etc/puppetlabs/client-tools/puppetdb.conf) is :\n\n~~~\n{\n \"puppetdb\": {\n \"server_urls\": \"https://puppetdb.doubledog.org:8081\",\n \"cacert\": \"/etc/puppet/ssl/certs/ca.pem\",\n \"cert\": \"/etc/puppet/ssl/certs/zuul.doubledog.org.pem\",\n \"key\": \"/etc/puppet/ssl/private_keys/zuul.doubledog.org.pem\"\n }\n}\n~~~\n\nThis leaves me with little to debug the connection with.\u00a0 I did an md5sum on the client /etc/puppet/ssl/certs/ca.pem and confirmed it matches both\u00a0/etc/puppetlabs/puppetdb/ssl/ca.pem and\u00a0/etc/puppetlabs/puppet/ssl/certs/ca.pem on the Master/DB host.\u00a0 What now?\u00a0 Could this be the CRL checking problem that agents have with the new(ish) intermediate CA cert?\u00a0 FWIW, this client requires\u00a0{{certificate_revocation = leaf}} to work around that issue.\n\n(My apologies for the markup, I can't make it work.)", "environment": "PuppetDB is on CentOS 7 using\u00a0puppetdb-6.3.4-1.el7.noarch from the puppet6 repo.\n\nThe CLI is on Fedora 30 using the puppetdb_cli-2.0.0.gem.\u00a0 This same host has\u00a0puppet-5.5.10-4.fc30.noarch from the regular Fedora repos.", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "50157", "fixedVersions": [], "id": "50157", "issueType": "Bug", "key": "PDB-4446", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "resolution": "Fixed", "resolutionDate": "2019-06-14T10:55:00.000000", "status": "Resolved", "statusCategory": "Done", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "Fix GIT_REF handling in ci-job-configs", "timeSpent": "PT0S", "updated": "2022-01-17T17:43:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [{"author": "623c0bc5a9575800695ac98a", "body": "the issue seems solved itself. I still do not understand what's happened. \n\nlooking on logs: \nit seems that the refresh of Service[puppetdb] took more than 4 hours. the next run of puppet, it pushes _Database_grant_ and puppetdb was happy with that.\n\nSomeone can help me to understand.? thanks \n\n{noformat}Jun 14 15:21:12 02 puppet-agent[1256]: (/Stage[main]/Puppetdb::Server/Ini_subsetting['-Xmx']/value) value changed '192m' to '2g'\nJun 14 15:21:12 02 puppet-agent[1256]: (/Stage[main]/Puppetdb::Server/Ini_subsetting['-Xmx']) Scheduling refresh of Service[puppetdb]\nJun 14 15:21:12 02 puppet-agent[1256]: (/Stage[main]/Puppetdb::Server/Ini_subsetting['-Xms']/ensure) created\nJun 14 15:21:12 02 puppet-agent[1256]: (/Stage[main]/Puppetdb::Server/Ini_subsetting['-Xms']) Scheduling refresh of Service[puppetdb]\nJun 14 15:27:40 02 puppet-agent[19742]: Run of Puppet configuration client already in progress", "created": "2019-06-17T03:09:00.000000"}, {"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "Since this seemed to fix itself and the error message was fairly non-specific, we'll close this one since we cannot reproduce it.\n\nIf you see this again please re-open it.", "created": "2019-08-13T14:39:00.000000"}], "components": ["PuppetDB"], "created": "2019-06-13T04:08:00.000000", "creator": "623c0bc5a9575800695ac98a", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Affects Build", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textfield", "value": "7.2.0"}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@35b0b72e"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Master Config", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Split"}, {"fieldName": "Master OS", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Other"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hzv3w7:"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "13/Aug/19"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_5308240195_*|*_6_*:*_1_*:*_0"}], "description": "working with the version that I uploaded from forge https://github.com/puppetlabs/puppetlabs-puppetdb/tree/7.2.0\npuppet-agent 5.5.8 - working on Ubuntu 18.04.\npuppet-server version: 5.3.6 - working on Ubuntu 18.04.\n\nmy puppet-run seems completely stuck applying the puppetdb recipes.\nsomeone could guide me for next steps. I am stuck. \n\nhere the message log on puppetdb: \nThe connection is not available - Caused by: org.postgresql.util.PSQLException: Connection to puppetdb.internet.net:5432 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.\n\n\n- here my puppetdb definition on manifest:\n{noformat}\nclass profile::puppetdb {\n\n class { '::puppetdb::database::postgresql' :\n listen_addresses => $::fqdn,\n manage_package_repo => false,\n postgres_version => '9.6',\n }\n class { '::puppetdb::server' :\n database_host => $::fqdn,\n automatic_dlo_cleanup => false,\n manage_firewall => false,\n listen_address => '0.0.0.0',\n ssl_deploy_certs => true,\n ssl_set_cert_paths => true,\n java_args => {\n '-Xmx' => '2g',\n '-Xms' => '512m',\n },\n }\n}{noformat}\n\n\n\n- here the last puppet-run (without errrors...)\n{noformat}\nNotice: /Stage[main]/Postgresql::Server::Install/Package[postgresql-server]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server/Package[puppetdb]/ensure: created\nInfo: /Stage[main]/Puppetdb::Server/Package[puppetdb]: Scheduling refresh of Service[puppetdb]\nNotice: /Stage[main]/Puppetdb::Server::Global/File[/etc/puppetlabs/puppetdb/conf.d/config.ini]/owner: owner changed 'root' to 'puppetdb'\nNotice: /Stage[main]/Puppetdb::Server::Global/File[/etc/puppetlabs/puppetdb/conf.d/config.ini]/group: group changed 'root' to 'puppetdb'\nNotice: /Stage[main]/Puppetdb::Server::Global/File[/etc/puppetlabs/puppetdb/conf.d/config.ini]/mode: mode changed '0644' to '0600'\nInfo: Class[Puppetdb::Server::Global]: Scheduling refresh of Service[puppetdb]\nNotice: /Stage[main]/Puppetdb::Server::Database/File[/etc/puppetlabs/puppetdb/conf.d/database.ini]/owner: owner changed 'root' to 'puppetdb'\nNotice: /Stage[main]/Puppetdb::Server::Database/File[/etc/puppetlabs/puppetdb/conf.d/database.ini]/group: group changed 'root' to 'puppetdb'\nNotice: /Stage[main]/Puppetdb::Server::Database/File[/etc/puppetlabs/puppetdb/conf.d/database.ini]/mode: mode changed '0644' to '0600'\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_psdatabase_username]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_psdatabase_password]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_classname]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_subprotocol]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_pgs]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_subname]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_gc_interval]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_node_ttl]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_node_purge_ttl]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_report_ttl]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_conn_max_age]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_conn_keep_alive]/ensure: created\nNotice: /Stage[main]/Puppetdb::Server::Database/Ini_setting[puppetdb_conn_lifetime]/ensure: created\nInfo: Class[Puppetdb::Server::Database]: Scheduling refresh of Service[puppetdb]\nNotice: /Stage[main]/Puppetdb::Server::Jetty/File[/etc/puppetlabs/puppetdb/conf.d/jetty.ini]/owner: owner changed 'root' to 'puppetdb'\nNotice: /Stage[main]/Puppetdb::Server::Jetty/File[/etc/puppetlabs/puppetdb/conf.d/jetty.ini]/group: group changed 'root' to 'puppetdb'\nNotice: /Stage[main]/Puppetdb::Server::Jetty/File[/etc/puppetlabs/puppetdb/conf.d/jetty.ini]/mode: mode changed '0644' to '0600'\nNotice: /Stage[main]/Puppetdb::Server::Jetty/Ini_setting[puppetdb_host]/ensure: created\nInfo: Class[Puppetdb::Server::Jetty]: Scheduling refresh of Service[puppetdb]\nNotice: /Stage[main]/Puppetdb::Server::Puppetdb/File[/etc/puppetlabs/puppetdb/conf.d/puppetdb.ini]/ensure: created\nInfo: Class[Puppetdb::Server::Puppetdb]: Scheduling refresh of Service[puppetdb]\nNotice: /Stage[main]/Puppetdb::Server/Ini_subsetting['-Xmx']/value: value changed '192m' to '2g'\nInfo: /Stage[main]/Puppetdb::Server/Ini_subsetting['-Xmx']: Scheduling refresh of Service[puppetdb]\nNotice: /Stage[main]/Puppetdb::Server/Ini_subsetting['-Xms']/ensure: created\nInfo: /Stage[main]/Puppetdb::Server/Ini_subsetting['-Xms']: Scheduling refresh of Service[puppetdb]\n{noformat}\n\n- here the puppetdb.log\n{noformat}\n2019-06-13 09:01:41,886 WARN [c.z.h.HikariConfig] The initializationFailFast propery is deprecated, see initializationFailTimeout\n2019-06-13 09:01:41,886 INFO [c.z.h.HikariDataSource] PDBMigrationsPool - Starting...\n2019-06-13 09:01:41,890 INFO [c.z.h.HikariDataSource] PDBMigrationsPool - Start completed.\n2019-06-13 09:01:56,891 INFO [c.z.h.HikariDataSource] PDBMigrationsPool - Shutdown initiated...\n2019-06-13 09:02:00,599 INFO [c.z.h.HikariDataSource] PDBMigrationsPool - Shutdown completed.\n2019-06-13 09:02:00,601 ERROR [p.p.c.services] Error while attempting to create connection pool\njava.sql.SQLTransientConnectionException: PDBMigrationsPool - Connection is not available, request timed out after 15000ms.\n at com.zaxxer.hikari.pool.HikariPool.createTimeoutException(HikariPool.java:602)\n at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:195)\n at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:145)\n at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:85)\n at clojure.java.jdbc$get_connection.invokeStatic(jdbc.clj:307)\n at clojure.java.jdbc$get_connection.invoke(jdbc.clj:197)\n at puppetlabs.puppetdb.cli.services$initialize_schema.invokeStatic(services.clj:318)\n at puppetlabs.puppetdb.cli.services$initialize_schema.invoke(services.clj:312)\n at puppetlabs.puppetdb.cli.services$init_with_db$fn__41128.invoke(services.clj:351)\n at puppetlabs.puppetdb.cli.services$init_with_db.invokeStatic(services.clj:347)\n at puppetlabs.puppetdb.cli.services$init_with_db.invoke(services.clj:331)\n at puppetlabs.puppetdb.cli.services$start_puppetdb.invokeStatic(services.clj:421)\n at puppetlabs.puppetdb.cli.services$start_puppetdb.invoke(services.clj:399)\n at puppetlabs.puppetdb.cli.services$reify__41242$service_fnk__13694__auto___positional$reify__41253.start(services.clj:509)\n at puppetlabs.trapperkeeper.services$eval13496$fn__13510$G__13486__13513.invoke(services.clj:9)\n at puppetlabs.trapperkeeper.services$eval13496$fn__13510$G__13485__13517.invoke(services.clj:9)\n at puppetlabs.trapperkeeper.internal$eval26140$run_lifecycle_fn_BANG___26147$fn__26148.invoke(internal.clj:198)\n at puppetlabs.trapperkeeper.internal$eval26140$run_lifecycle_fn_BANG___26147.invoke(internal.clj:181)\n at puppetlabs.trapperkeeper.internal$eval26169$run_lifecycle_fns__26174$fn__26175.invoke(internal.clj:231)\n at puppetlabs.trapperkeeper.internal$eval26169$run_lifecycle_fns__26174.invoke(internal.clj:208)\n at puppetlabs.trapperkeeper.internal$eval26651$build_app_STAR___26660$fn$reify__26670.start(internal.clj:586)\n at puppetlabs.trapperkeeper.internal$eval26697$boot_services_for_app_STAR__STAR___26704$fn__26705$fn__26707.invoke(internal.clj:612)\n at puppetlabs.trapperkeeper.internal$eval26697$boot_services_for_app_STAR__STAR___26704$fn__26705.invoke(internal.clj:610)\n at puppetlabs.trapperkeeper.internal$eval26697$boot_services_for_app_STAR__STAR___26704.invoke(internal.clj:604)\n at clojure.core$partial$fn__4761.invoke(core.clj:2521)\n at puppetlabs.trapperkeeper.internal$eval26210$initialize_lifecycle_worker__26221$fn__26222$fn__26318$state_machine__18315__auto____26319$fn__26321.invoke(internal.clj:251)\n at puppetlabs.trapperkeeper.internal$eval26210$initialize_lifecycle_worker__26221$fn__26222$fn__26318$state_machine__18315__auto____26319.invoke(internal.clj:251)\n at clojure.core.async.impl.ioc_macros$run_state_machine.invokeStatic(ioc_macros.clj:1012)\n at clojure.core.async.impl.ioc_macros$run_state_machine.invoke(ioc_macros.clj:1011)\n at clojure.core.async.impl.ioc_macros$run_state_machine_wrapped.invokeStatic(ioc_macros.clj:1016)\n at clojure.core.async.impl.ioc_macros$run_state_machine_wrapped.invoke(ioc_macros.clj:1014)\n at clojure.core.async$ioc_alts_BANG_$fn__18483.invoke(async.clj:383)\n at clojure.core.async$do_alts$fn__18429$fn__18432.invoke(async.clj:252)\n at clojure.core.async.impl.channels.ManyToManyChannel$fn__17041$fn__17042.invoke(channels.clj:95)\n at clojure.lang.AFn.run(AFn.java:22)\n at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)\n at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n at java.base/java.lang.Thread.run(Thread.java:844)\nCaused by: org.postgresql.util.PSQLException: Connection to puppetdb.internet.net:5432 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.\n at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:252)\n at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:66)\n at org.postgresql.jdbc.PgConnection.(PgConnection.java:215)\n at org.postgresql.Driver.makeConnection(Driver.java:406)\n at org.postgresql.Driver.connect(Driver.java:274)\n at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:95)\n at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:101)\n at com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:356)\n at com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:199)\n at com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:444)\n at com.zaxxer.hikari.pool.HikariPool.access$200(HikariPool.java:71)\n at com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:631)\n at com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:617)\n at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n ... 3 common frames omitted\nCaused by: java.net.ConnectException: Connection refused (Connection refused)\n at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)\n at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:400)\n at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:243)\n at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:225)\n at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:402)\n at java.base/java.net.Socket.connect(Socket.java:591)\n at org.postgresql.core.PGStream.(PGStream.java:64)\n at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:133)\n ... 16 common frames omitted\n{noformat}\n\n- here network open connection log\n{noformat}\n# netstat -tulnp|grep postgres\ntcp 0 0 127.0.0.1:5432 0.0.0.0:* LISTEN 14226/postgres\ntcp6 0 0 ::1:5432 :::* LISTEN 14226/postgres\n{noformat}\n\n- here postgres log\n{noformat}\nroot@01:~# cat /var/log/postgresql/postgresql-9.6-main.log\n2019-06-13 08:59:10.708 UTC [14236] LOG: database system was shut down at 2019-06-13 08:59:09 UTC\n2019-06-13 08:59:10.709 UTC [14236] LOG: MultiXact member wraparound protections are now enabled\n2019-06-13 08:59:10.712 UTC [14226] LOG: database system is ready to accept connections\n2019-06-13 08:59:10.713 UTC [14241] LOG: autovacuum launcher started\n2019-06-13 08:59:11.177 UTC [14244] [unknown]@[unknown] LOG: incomplete startup packet\n{noformat}\n\n- here the Postgres config\n{noformat}\ngrep -o '^[^#]*' /etc/postgresql/9.6/main/postgresql.conf|sort\n\ncluster_name = '9.6/main'\ndata_directory = '/var/lib/postgresql/9.6/main'\ndatestyle = 'iso, mdy'\ndefault_text_search_config = 'pg_catalog.english'\ndynamic_shared_memory_type = posix\nexternal_pid_file = '/var/run/postgresql/9.6-main.pid'\nhba_file = '/etc/postgresql/9.6/main/pg_hba.conf'\nident_file = '/etc/postgresql/9.6/main/pg_ident.conf'\ninclude_dir = 'conf.d'\nlc_messages = 'en_US.UTF-8'\nlc_monetary = 'en_US.UTF-8'\nlc_numeric = 'en_US.UTF-8'\nlc_time = 'en_US.UTF-8'\nlisten_addresses = 'puppetdb.internet.net'\nlog_line_prefix = '%m [%p] %q%u@%d '\nlog_timezone = UTC\nmax_connections = 100\nport = 5432\nshared_buffers = 128MB\nssl_cert_file = '/etc/ssl/certs/ssl-cert-snakeoil.pem'\nssl_key_file = '/etc/ssl/private/ssl-cert-snakeoil.key'\nssl = on\nstats_temp_directory = '/var/run/postgresql/9.6-main.pg_stat_tmp'\ntimezone = UTC\nunix_socket_directories = '/var/run/postgresql'\n{noformat}\n", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "49064", "fixedVersions": [], "id": "49064", "issueType": "Bug", "key": "PDB-4401", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Normal", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:ba5ecb63-e127-4c90-834b-c71fdc004e8c", "resolution": "Won't Do", "resolutionDate": "2022-01-12T13:02:00.000000", "status": "Closed", "statusCategory": "Done", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "SPIKE: investigate improving reports / resource events table", "timeSpent": "PT0S", "updated": "2022-01-12T13:02:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [{"attacher": "623c1251a1d81f0069d8e18c", "created": "2019-04-30T11:25:00.000000", "name": "evidence.log", "uri": "https://puppet.atlassian.net/rest/api/3/attachment/content/14100"}, {"attacher": "623c1251a1d81f0069d8e18c", "created": "2019-04-24T11:30:00.000000", "name": "log", "uri": "https://puppet.atlassian.net/rest/api/3/attachment/content/13987"}, {"attacher": "623c1251a1d81f0069d8e18c", "created": "2019-04-24T11:30:00.000000", "name": "puppetdb", "uri": "https://puppet.atlassian.net/rest/api/3/attachment/content/14160"}, {"attacher": "623c1251a1d81f0069d8e18c", "created": "2019-04-24T12:28:00.000000", "name": "puppetdb.log", "uri": "https://puppet.atlassian.net/rest/api/3/attachment/content/14099"}, {"attacher": "623c1251a1d81f0069d8e18c", "created": "2019-04-30T11:26:00.000000", "name": "puppetdb.log", "uri": "https://puppet.atlassian.net/rest/api/3/attachment/content/14118"}, {"attacher": "623c1251a1d81f0069d8e18c", "created": "2019-04-30T12:18:00.000000", "name": "realtime_puppetdb.log", "uri": "https://puppet.atlassian.net/rest/api/3/attachment/content/13988"}, {"attacher": "623c1251a1d81f0069d8e18c", "created": "2019-04-30T12:18:00.000000", "name": "realtime_puppetdb_acess.log", "uri": "https://puppet.atlassian.net/rest/api/3/attachment/content/14161"}, {"attacher": "623c1251a1d81f0069d8e18c", "created": "2019-04-30T12:18:00.000000", "name": "realtime_puppetserver.log", "uri": "https://puppet.atlassian.net/rest/api/3/attachment/content/14013"}], "comments": [{"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "That looks like Puppet Server's generic log message for a failure response from PuppetDB, can you find the error from your PuppetDB log as well?", "created": "2019-04-11T11:53:00.000000"}, {"author": "623c1251a1d81f0069d8e18c", "body": "[~accountid:557058:613151bd-b161-4bc3-9e32-335fdcef4d89] I have changed the loglevel for puppetdb since I was not getting any relevant error. Sadly I am not able to replicate the issue by myself, I will wait and try to catch when the errors show up", "created": "2019-04-11T12:14:00.000000"}, {"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "[~accountid:623c1251a1d81f0069d8e18c] did you anonymize that log message ie {{certname=HOSTNAME}} and {{'server_urls': [https://PUPPETDBHOSTNAME:8081|https://puppetdbhostname:8081/]}}?\n\nIf not you're likely missing some configuration for communication between Puppet Server and PuppetDB. You can follow the docs here [https://puppet.com/docs/puppetdb/6.3/connect_puppet_master.html]", "created": "2019-04-11T13:01:00.000000"}, {"author": "623c1251a1d81f0069d8e18c", "body": "[~accountid:557058:613151bd-b161-4bc3-9e32-335fdcef4d89] yes, you are correct, those names are\u00a0anonymized .\u00a0", "created": "2019-04-11T13:05:00.000000"}, {"author": "623c1251a1d81f0069d8e18c", "body": "[~accountid:557058:613151bd-b161-4bc3-9e32-335fdcef4d89] what log level would you recommend me? I tried INFO but I am having a hard time trying to get the error.\n\nI have 3 puppet servers and I am using a load balancer, the puppet1 has setup puppetdb and has more resources than puppet2 and puppet3 , I get these puppetdb errors in the puppetserverlog in sporadic times in the puppet[1-3] servers but I do not see anything relevant in the puppetdb in puppet1\u00a0", "created": "2019-04-18T11:29:00.000000"}, {"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "[~accountid:623c1251a1d81f0069d8e18c] Are you seeing a warning message along with the Puppetserver error you first attached?\n\n\u00a0\n\nThere are two warnings you could see\n{code:java}\"Error connecting to #{server_url.host} on #{server_url.port} at route #{route}, \" \\\n \"error message received was '#{response.message}'. #{SERVER_URL_FAIL_MSG}\"{code}\nor\n{code:java}\"Error connecting to #{server_url.host} on #{server_url.port} at route #{route}, \" \\\n \"error message received was '#{response.message}'. #{SERVER_URL_FAIL_MSG}\"{code}\n\u00a0\n\n\u00a0\n\nIf you don't see one of those, then enable debug logging for Puppetserver and look for a message like\n{code:java}\"HTTP 404 (probably normal) when connecting to #{server_url.host} on #{server_url.port} \" \\\n \"at route #{route}, error message received was '#{response.message}'. #{SERVER_URL_FAIL_MSG}\"{code}", "created": "2019-04-18T12:30:00.000000"}, {"author": "623c1251a1d81f0069d8e18c", "body": "2019-04-18T17:31:43.527-07:00 ERROR [qtp853282096-1040] [c.p.h.c.i.PersistentSyncHttpClient] Error executing http request\n2019-04-18T17:31:43.543-07:00 WARN [qtp853282096-1040] [puppetserver] Puppet Error connecting to puppetdb on 8081 at route /pdb/cmd/v1?checksum=f0173d7686071f91c04be589c5b605ee7d0a40f2&version=8&certname=dev-kjeon1&command=store_report&producer-timestamp=2019-04-19T00:31:43.460Z, error message received was 'Error executing http request'. Failing over to the next PuppetDB server_url in the 'server_urls' list\n2019-04-18T17:31:43.551-07:00 ERROR [qtp853282096-1040] [puppetserver] Puppet Failed to execute '/pdb/cmd/v1?checksum=f0173d7686071f91c04be589c5b605ee7d0a40f2&version=8&certname=dev-kjeon1&command=store_report&producer-timestamp=2019-04-19T00:31:43.460Z' on at least 1 of the following 'server_urls': https://puppetdb:8081\n2019-04-18T17:31:43.552-07:00 ERROR [qtp853282096-1040] [puppetserver] Puppet /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/puppetdb/http.rb:115:in `raise_request_error' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/puppetdb/http.rb:156:in `failover_action' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/puppetdb/http.rb:216:in `action' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/puppetdb/command.rb:64:in `block in submit' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/profiler/around_profiler.rb:58:in `profile' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/profiler.rb:51:in `profile' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/puppetdb.rb:99:in `profile' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/puppetdb/command.rb:63:in `submit' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/puppetdb.rb:62:in `block in submit_command' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/profiler/around_profiler.rb:58:in `profile' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/profiler.rb:51:in `profile' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/puppetdb.rb:99:in `profile' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/puppetdb.rb:59:in `submit_command' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/reports/puppetdb.rb:24:in `block in process' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/profiler/around_profiler.rb:58:in `profile' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/profiler.rb:51:in `profile' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/puppetdb.rb:99:in `profile' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/reports/puppetdb.rb:21:in `process' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/indirector/report/processor.rb:37:in `block in process' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/indirector/report/processor.rb:53:in `block in processors' org/jruby/RubyArray.java:1801:in `each' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/indirector/report/processor.rb:51:in `processors' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/indirector/report/processor.rb:30:in `process' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/indirector/report/processor.rb:14:in `save' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/indirector/indirection.rb:285:in `save' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/api/indirected_routes.rb:187:in `do_save' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/api/indirected_routes.rb:54:in `block in call' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:65:in `override' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:264:in `override' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/api/indirected_routes.rb:53:in `call' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/route.rb:82:in `block in process' org/jruby/RubyArray.java:1801:in `each' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/route.rb:81:in `process' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/route.rb:87:in `process' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/route.rb:87:in `process' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/handler.rb:87:in `block in process' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/handler.rb:70:in `block in with_request_profiling' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/profiler/around_profiler.rb:58:in `profile' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/util/profiler.rb:51:in `profile' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/handler.rb:66:in `with_request_profiling' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/handler.rb:86:in `block in process' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/handler.rb:93:in `respond_to_errors' /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/handler.rb:85:in `process' uri:classloader:/puppetserver-lib/puppet/server/master.rb:45:in `handleRequest'\n2019-04-18T17:31:43.590-07:00 ERROR [qtp853282096-1040] [puppetserver] Puppet Report processor failed: Failed to execute '/pdb/cmd/v1?checksum=f0173d7686071f91c04be589c5b605ee7d0a40f2&version=8&certname=dev-kjeon1&command=store_report&producer-timestamp=2019-04-19T00:31:43.460Z' on at least 1 of the following 'server_urls': https://puppetdb:8081\n/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/network/http/handler.rb:93:in `respond_to_errors'", "created": "2019-04-18T19:36:00.000000"}, {"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "Ok so the important piece in that PuppetServer log is\n{code}2019-04-18T17:31:43.543-07:00 WARN [qtp853282096-1040] [puppetserver] Puppet Error connecting to puppetdb on 8081 at route /pdb/cmd/v1?checksum=f0173d7686071f91c04be589c5b605ee7d0a40f2&version=8&certname=dev-kjeon1&command=store_report&producer-timestamp=2019-04-19T00:31:43.460Z, error message received was 'Error executing http request'. Failing over to the next PuppetDB server_url in the 'server_urls' list\n{code}\nThat warning means one of a few things. Most commonly, that's the message you'll see if PuppetDB is starting up. If that's the case, in the corresponding log messages for PuppetDB you'll see\n{code}2019-04-18T17:31:43.543-07:00 INFO [p.p.pdb-routing] HTTP request received while in maintenance mode\n{code}\nOther than that, the field of options opens up a bit. One possibility is that one of the puppetservers is misconfigured in its communication to PuppetDB, but it doesn't sound like it's misconfigured because it's not always happening. The other option is that something specific about the {{dev-kjeon1}} manifest is causing an error (such as an invalid character). If that's the case you should _certainly_ see an error message in PuppetDB.", "created": "2019-04-19T09:00:00.000000"}, {"author": "623c1251a1d81f0069d8e18c", "body": "hi [~accountid:557058:613151bd-b161-4bc3-9e32-335fdcef4d89] the host dev-kjeon1 is just an example, it happens from time to time with different hosts . I have only found an error on the puppetdb.log file :\n\n{code}\n2019-04-22T11:45:14.721-07:00 ERROR [p.p.c.services] Error during garbage collection2019-04-22T11:45:14.721-07:00 ERROR [p.p.c.services] Error during garbage collectionjava.sql.BatchUpdateException: Batch entry 0 with recursive live_paths(path, value) as\u00a0 \u00a0(select key as path, value\u00a0 \u00a0 \u00a0 from (select (jsonb_each(stable||volatile)).* from factsets) as base_case\u00a0 \u00a0 \u00a0 union\u00a0 \u00a0 \u00a0 \u00a0 select path||'#~'||sub_level.key as path,\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0sub_level.value\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 from live_paths,\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 lateral (select *\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0from (select (jsonb_each(value)).*\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0where jsonb_typeof(value) = 'object') as sub_fields\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0union (select generate_series(0, jsonb_array_length(value - 1))::text as key,\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0jsonb_array_elements(value) as value\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 where jsonb_typeof(value) = 'array')) as sub_level)\u00a0 \u00a0select path into unlogged tmp_live_paths from live_paths was aborted: ERROR: relation \"tmp_live_paths\" already exists\u00a0 Call getNextException to see other errors in the batch. at org.postgresql.jdbc.BatchResultHandler.handleError(BatchResultHandler.java:148) at org.postgresql.core.ResultHandlerDelegate.handleError(ResultHandlerDelegate.java:50) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2179) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:479) at org.postgresql.jdbc.PgStatement.executeBatch(PgStatement.java:835) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:128) at com.zaxxer.hikari.pool.HikariProxyStatement.executeBatch(HikariProxyStatement.java) at clojure.java.jdbc$execute_batch.invokeStatic(jdbc.clj:563) at clojure.java.jdbc$execute_batch.invoke(jdbc.clj:556) at clojure.java.jdbc$db_do_commands$fn__21279.invoke(jdbc.clj:906) at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:814) at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741) at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:754) at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741) at clojure.java.jdbc$db_do_commands.invokeStatic(jdbc.clj:905) at clojure.java.jdbc$db_do_commands.invoke(jdbc.clj:890) at puppetlabs.puppetdb.jdbc$do_commands.invokeStatic(jdbc.clj:38) at puppetlabs.puppetdb.jdbc$do_commands.doInvoke(jdbc.clj:33) at clojure.lang.RestFn.invoke(RestFn.java:457) at puppetlabs.puppetdb.scf.storage$delete_unused_fact_paths.invokeStatic(storage.clj:1151) at puppetlabs.puppetdb.scf.storage$delete_unused_fact_paths.invoke(storage.clj:1140) at puppetlabs.puppetdb.scf.storage$garbage_collect_BANG_$fn__27899$fn__27902.invoke(storage.clj:1468) at puppetlabs.puppetdb.jdbc$with_transacted_connection_fn$fn__21879$fn__21880.invoke(jdbc.clj:483) at clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:771) at clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:741) at puppetlabs.puppetdb.jdbc$with_transacted_connection_fn$fn__21879.invoke(jdbc.clj:482) at puppetlabs.puppetdb.jdbc$fn__21857$retry_sql_STAR___21862$fn__21863$fn__21864.invoke(jdbc.clj:454) at puppetlabs.puppetdb.jdbc$fn__21857$retry_sql_STAR___21862$fn__21863.invoke(jdbc.clj:453) at puppetlabs.puppetdb.jdbc$fn__21857$retry_sql_STAR___21862.invoke(jdbc.clj:444) at puppetlabs.puppetdb.jdbc$with_transacted_connection_fn.invokeStatic(jdbc.clj:480) at puppetlabs.puppetdb.jdbc$with_transacted_connection_fn.invoke(jdbc.clj:469) at puppetlabs.puppetdb.scf.storage$garbage_collect_BANG_$fn__27899.invoke(storage.clj:1465) at puppetlabs.puppetdb.scf.storage.proxy$java.lang.Object$Callable$7da976d4.call(Unknown Source) at com.codahale.metrics.Timer.time(Timer.java:101) at puppetlabs.puppetdb.scf.storage$garbage_collect_BANG_.invokeStatic(storage.clj:1459) at puppetlabs.puppetdb.scf.storage$garbage_collect_BANG_.invoke(storage.clj:1456) at puppetlabs.puppetdb.cli.services$garbage_collect_BANG_.invokeStatic(services.clj:193) at puppetlabs.puppetdb.cli.services$garbage_collect_BANG_.invoke(services.clj:184) at puppetlabs.puppetdb.cli.services$fn__34894$clean_up__34899$fn__34903$fn__34913.invoke(services.clj:263) at puppetlabs.puppetdb.cli.services.proxy$java.lang.Object$Callable$7da976d4.call(Unknown Source) at com.codahale.metrics.Timer.time(Timer.java:101) at puppetlabs.puppetdb.cli.services$fn__34894$clean_up__34899$fn__34903.invoke(services.clj:262) at puppetlabs.puppetdb.cli.services$fn__34894$clean_up__34899.invoke(services.clj:224) at puppetlabs.puppetdb.cli.services$collect_garbage.invokeStatic(services.clj:384) at puppetlabs.puppetdb.cli.services$collect_garbage.invoke(services.clj:379) at puppetlabs.puppetdb.cli.services$coordinate_gc_with_shutdown.invokeStatic(services.clj:400) at puppetlabs.puppetdb.cli.services$coordinate_gc_with_shutdown.invoke(services.clj:390) at puppetlabs.puppetdb.cli.services$start_puppetdb$fn__34986.invoke(services.clj:477) at clojure.lang.AFn.run(AFn.java:22) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)Caused by: org.postgresql.util.PSQLException: ERROR: relation \"tmp_live_paths\" already exists at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2433) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2178)\n{code}\n\nI have set this value :\n\n{code}\ngc-interval = 60\n{code}\n\nWe are running pgsql 10.7-2", "created": "2019-04-22T12:59:00.000000"}, {"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "Oh thanks, that's a real error with our attempt to make our jsonb gc compatible with postgres 10. But I don't believe that's the culprit with respect to your submission errors.\n\nWould you mind attaching a full PuppetDB log?", "created": "2019-04-22T15:09:00.000000"}, {"author": "623c1251a1d81f0069d8e18c", "body": "Attached 2 log files, file named log is the error of the puppetserver and puppetdb is an extract of the puppetdb log that matches the time when the error ocurred. let me know if more details need to be attached ", "created": "2019-04-24T11:31:00.000000"}, {"author": "557058:613151bd-b161-4bc3-9e32-335fdcef4d89", "body": "It looks like in that instance, PuppetServer received the error response at 00:03:32.297 (Format is HH:MM:SS.milliseconds) but your PuppetDB log starts at 00:03:32.990, which is 0.693 seconds after PuppetServer has already received the response. Can you attach the puppetdb logs starting at 00:03:00.000 all the way to 00:03:33.000 to be sure that we can see when PuppetDB was receiving the request?", "created": "2019-04-24T12:04:00.000000"}, {"author": "623c1251a1d81f0069d8e18c", "body": "New log file attached\u00a0", "created": "2019-04-24T12:28:00.000000"}, {"author": "623c1251a1d81f0069d8e18c", "body": "More evidence provided.\n\nUpdate : I have moved the pgsql database to the same server where puppetdb is running and upgraded pgsql to version 11.\n\nI see no improvements .\n\nI am attaching evidence.log which contains the puppetserver.log , puppetdb-acces.log and an extract from the journalctl of the VM where the error occurred and the log from puppetdb.", "created": "2019-04-30T11:24:00.000000"}, {"author": "623c1251a1d81f0069d8e18c", "body": "I was able to catch the error in real time in puppetdb.log, puppetserver.log and puppetdb-access.log", "created": "2019-04-30T12:17:00.000000"}, {"author": "557058:f757c9dc-2f3a-4787-8e3b-41426b249a1f", "body": "[~accountid:557058:613151bd-b161-4bc3-9e32-335fdcef4d89]\n\nwe upgraded all our puppet servers to these versions :\n\n{code}\n\npuppetdb-termini-6.3.2-1.el7.noarch\npuppetdb-6.3.2-1.el7.noarch\npuppet-agent-6.4.2-1.el7.x86_64\npuppetserver-6.3.0-1.el7.noarch\n\n{code}\n\nAfter the upgrade I have not seen the puppetdb issue again. do you think is related? \n\nI took a look at https://github.com/puppetlabs/puppetdb/compare/6.3.2...master , please let me know .", "created": "2019-05-01T17:52:00.000000"}, {"author": "61af86343618cd006f430854", "body": "Closing due to lack of activity. If you feel this was in error, feel free to add a comment to explain why you would like to re-open the ticket.\n", "created": "2022-01-12T13:02:00.000000"}], "components": ["PuppetDB"], "created": "2019-04-11T11:50:00.000000", "creator": "623c1251a1d81f0069d8e18c", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@24c7b4f"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hztz3r:"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "11/Apr/19"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_87012733040_*|*_6_*:*_1_*:*_0"}], "description": "I managed around 1000 nodes in our stg environment and I get daily reports like the one below from different servers.\n\nMy puppet server got 20GB ram and 8 CPUs . It rans puppet server and puppetdb , Java memory for puppetserver is 12 Gb and 3 Gb for puppetdb, I have tried to tunning the settings, but I have not seen improvements\u00a0\n\n2019-04-11T02:52:52.616-07:00 ERROR [qtp974514354-53945] [puppetserver] Puppet Failed to execute '/pdb/cmd/v1?checksum=9be7293b34465f977f72a402b1def5b85a041266&version=9&certname=HOSTNAME&command=replace_catalog&producer-timestamp=2019-04-11T09:52:11.981Z' on at least 1 of the following 'server_urls': https://PUPPETDBHOSTNAME:8081\n2019\n\nPuppetDB v6.3.0", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "51071", "fixedVersions": [], "id": "51071", "issueType": "Bug", "key": "PDB-4339", "labels": [], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Major", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:0a2bfc9c-1912-49b1-9776-665ef20c8769", "status": "Accepted", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "(docs) Clarify where to put config file during module install", "timeSpent": "PT0S", "updated": "2022-03-01T11:51:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": "557058:ba5ecb63-e127-4c90-834b-c71fdc004e8c", "attachments": [], "comments": [], "components": ["PuppetDB"], "created": "2019-03-18T16:45:00.000000", "creator": "557058:ba5ecb63-e127-4c90-834b-c71fdc004e8c", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@5264b346"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hztg6v:"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "Release Notes Summary", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textarea", "value": "Bug caught before release"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_2_*:*_25985_*|*_3_*:*_1_*:*_85865070_*|*_10009_*:*_1_*:*_68052520_*|*_5_*:*_1_*:*_543198818_*|*_6_*:*_1_*:*_0"}], "description": "During a migration to add a primary key to the resource_events table, the following error occurred:\n\n{noformat}\n2019-03-18T14:46:11.220-07:00 ERROR [p.p.s.migrate] Caught SQLException during migration\norg.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint \"resource_events_transform_pkey\"\nDetail: Key (event_hash)=(\\x766eb99a3d40d81416446c565fed3866cf8226f6) already exists.\n at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2433)\n at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2178)\n at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:306)\n{noformat}\n\nInvestigate if there's an issue with the migration, and add the hash lookup logic from the reports table migration if necessary.", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "52616", "fixedVersions": ["PDB 6.3.0"], "id": "52616", "issueType": "Bug", "key": "PDB-4312", "labels": ["customer0"], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Blocker", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:0a2bfc9c-1912-49b1-9776-665ef20c8769", "status": "Accepted", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:09 AM", "summary": "(docs) Incorrect command in PDB 6.2 docs", "timeSpent": "PT0S", "updated": "2022-03-03T06:22:00.000000", "votes": "0", "watchers": []}, {"affectedVersions": [], "assignee": null, "attachments": [], "comments": [{"author": "6230fa3962dc1e0068025c1c", "body": "I encountered the same issue for the resources endpoint when for example querying a resource parameter:\n{code:java}\n[\"null?\", [\"parameter\", \"parametername\"], true]\n{code}\nIs there any plan to support this type of query?\n\nIn any case, also if not supported it should reply with an error instead of a 500 in my humble opinion.\n\nIs there any workaround to query a resource with a parameter set to undef that I could use?", "created": "2020-06-19T08:02:00.000000"}, {"author": "623c1489a1d81f0069d8e30a", "body": "On the 6.x branch of PDB, when running\u00a0\n{code}curl -sX GET http://localhost:8080/pdb/query/v4/nodes --data-urlencode 'query=[\"null?\", [\"fact\", \"id\"], false]'\n{code}\nwe get\n{code}class clojure.lang.PersistentVector cannot be cast to class java.lang.CharSequence (clojure.lang.PersistentVector is in unnamed module of loader 'app'", "created": "2021-09-01T01:51:00.000000"}, {"author": "623c1489a1d81f0069d8e30a", "body": "We should determine on what endpoints \"null?\" works and on which ones it errors.", "created": "2021-09-01T01:56:00.000000"}], "components": ["PuppetDB"], "created": "2019-03-13T14:22:00.000000", "creator": "557058:836ef76e-8051-48a3-8dc7-005f79695b0e", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Acceptance Criteria", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textarea", "value": "Either queries on \"null?\" values of facts against the {{nodes}} endpoint work, or we document that they won't and why not."}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@104b572c"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "CS Priority", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Reviewed"}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Customer Feedback"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|o0d1q7:wo"}, {"fieldName": "Zendesk Ticket Count", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:float", "value": "1.0"}, {"fieldName": "Zendesk Ticket IDs", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:textarea", "value": "34133"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "13/Mar/19"}], "description": "*Steps to reproduce*\n\nQuery a running PDB instance for nodes where a fact is or is not null:\n{code}curl -sX GET http://localhost:8080/pdb/query/v4/nodes --data-urlencode 'query=[\"null?\", [\"fact\", \"id\"], false]'\n{code}\n*Expected behavior*\n\nThe response contains the matching list of nodes.\n\n*Observed behavior*\n{code}HTTP ERROR 500\n\nProblem accessing /pdb/query/v4/nodes. Reason:\n\n Server Error\nCaused by:\nclojure.lang.ExceptionInfo: Value does not match schema: (not (map? nil)) {:type :schema.core/error, :schema {:type Keyword, :field (cond-pre Keyword honeysql.types.SqlCall honeysql.types.SqlRaw {:select Any, Any Any}), Any Any}, :value nil, :error (not (map? nil))}\n\tat schema.core$validator$fn__7917.invoke(core.clj:155)\n\tat schema.core$validate.invokeStatic(core.clj:164)\n\tat schema.core$validate.invoke(core.clj:159)\n\tat puppetlabs.puppetdb.query_eng.engine$eval34226$fn__34228.invoke(engine.clj:1228)\n\tat puppetlabs.puppetdb.query_eng.engine$eval34156$fn__34157$G__34147__34162.invoke(engine.clj:1130)\n\tat clojure.core$map$fn__4785.invoke(core.clj:2646)\n\tat clojure.lang.LazySeq.sval(LazySeq.java:40)\n\tat clojure.lang.LazySeq.seq(LazySeq.java:56)\n\tat clojure.lang.ChunkedCons.chunkedNext(ChunkedCons.java:59)\n\tat clojure.lang.ChunkedCons.next(ChunkedCons.java:43)\n\tat clojure.lang.RT.next(RT.java:688)\n\tat clojure.core$next__4341.invokeStatic(core.clj:64)\n\tat clojure.core$nthnext.invokeStatic(core.clj:3062)\n\tat clojure.core$nthnext.invoke(core.clj:3055)\n\tat honeysql.format$format_predicate_STAR_.invokeStatic(format.clj:359)\n\tat honeysql.format$format_predicate_STAR_.invoke(format.clj:356)\n\tat honeysql.format$eval29381$fn__29383.invoke(format.clj:414)\n\tat clojure.lang.MultiFn.invoke(MultiFn.java:233)\n\tat honeysql.format$_format_clause.invokeStatic(format.clj:394)\n\tat honeysql.format$_format_clause.invoke(format.clj:391)\n\tat honeysql.format$eval29313$fn__29314$fn__29315$fn__29316.invoke(format.clj:326)\n\tat clojure.core$comp$fn__4727.invoke(core.clj:2460)\n\tat clojure.core$map$fn__4785.invoke(core.clj:2646)\n\tat clojure.lang.LazySeq.sval(LazySeq.java:40)\n\tat clojure.lang.LazySeq.seq(LazySeq.java:49)\n\tat clojure.lang.Cons.next(Cons.java:39)\n\tat clojure.lang.RT.next(RT.java:688)\n\tat clojure.core$next__4341.invokeStatic(core.clj:64)\n\tat clojure.string$join.invokeStatic(string.clj:191)\n\tat clojure.string$join.invoke(string.clj:180)\n\tat honeysql.format$space_join.invokeStatic(format.clj:15)\n\tat honeysql.format$space_join.invoke(format.clj:14)\n\tat honeysql.format$eval29313$fn__29314$fn__29315.invoke(format.clj:325)\n\tat honeysql.format$eval29313$fn__29314.invoke(format.clj:323)\n\tat honeysql.format$eval29103$fn__29104$G__29094__29109.invoke(format.clj:90)\n\tat honeysql.format$format.invokeStatic(format.clj:236)\n\tat honeysql.format$format.doInvoke(format.clj:208)\n\tat clojure.lang.RestFn.invoke(RestFn.java:410)\n\tat puppetlabs.puppetdb.query_eng.engine$eval34121$sql_from_query__34126$fn__34127.invoke(engine.clj:1124)\n\tat puppetlabs.puppetdb.query_eng.engine$eval34121$sql_from_query__34126.invoke(engine.clj:1121)\n\tat puppetlabs.puppetdb.query_eng.engine$eval34254$fn__34256.invoke(engine.clj:1139)\n\tat puppetlabs.puppetdb.query_eng.engine$eval34156$fn__34157$G__34147__34162.invoke(engine.clj:1130)\n\tat puppetlabs.puppetdb.query_eng.engine$plan__GT_sql.invokeStatic(engine.clj:1258)\n\tat puppetlabs.puppetdb.query_eng.engine$plan__GT_sql.invoke(engine.clj:1255)\n\tat puppetlabs.puppetdb.query_eng.engine$compile_user_query__GT_sql.invokeStatic(engine.clj:2344)\n\tat puppetlabs.puppetdb.query_eng.engine$compile_user_query__GT_sql.doInvoke(engine.clj:2326)\n\tat clojure.lang.RestFn.invoke(RestFn.java:442)\n\tat puppetlabs.puppetdb.query_eng$query__GT_sql.invokeStatic(query_eng.clj:109)\n\tat puppetlabs.puppetdb.query_eng$query__GT_sql.invoke(query_eng.clj:85)\n\tat puppetlabs.puppetdb.query_eng$eval35379$produce_streaming_body__35384$fn__35385$fn__35388.invoke(query_eng.clj:193)\n\tat puppetlabs.puppetdb.jdbc$with_transacted_connection_fn$fn__28868$fn__28869.invoke(jdbc.clj:483)\n\tat clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:628)\n\tat clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:598)\n\tat puppetlabs.puppetdb.jdbc$with_transacted_connection_fn$fn__28868.invoke(jdbc.clj:482)\n\tat puppetlabs.puppetdb.jdbc$eval28842$retry_sql_STAR___28847$fn__28848$fn__28849.invoke(jdbc.clj:454)\n\tat puppetlabs.puppetdb.jdbc$eval28842$retry_sql_STAR___28847$fn__28848.invoke(jdbc.clj:453)\n\tat puppetlabs.puppetdb.jdbc$eval28842$retry_sql_STAR___28847.invoke(jdbc.clj:444)\n\tat puppetlabs.puppetdb.jdbc$with_transacted_connection_fn.invokeStatic(jdbc.clj:480)\n\tat puppetlabs.puppetdb.jdbc$with_transacted_connection_fn.invoke(jdbc.clj:469)\n\tat puppetlabs.puppetdb.query_eng$eval35379$produce_streaming_body__35384$fn__35385.invoke(query_eng.clj:189)\n\tat puppetlabs.puppetdb.query_eng$eval35379$produce_streaming_body__35384.invoke(query_eng.clj:175)\n\tat puppetlabs.puppetdb.http.query$query_handler$fn__38744.invoke(query.clj:377)\n\tat clojure.core$comp$fn__4727.invoke(core.clj:2460)\n\tat clojure.core$comp$fn__4727.invoke(core.clj:2460)\n\tat compojure.response$eval22857$fn__22858.invoke(response.clj:33)\n\tat compojure.response$eval22812$fn__22813$G__22803__22820.invoke(response.clj:6)\n\tat puppetlabs.puppetdb.http.handlers$eval39273$node_routes__39278$fn__39279$fn__39280.invoke(handlers.clj:309)\n\tat puppetlabs.puppetdb.http.query$extract_query$fn__38730.invoke(query.clj:311)\n\tat bidi.ring$eval36625$fn__36626.invoke(ring.clj:20)\n\tat bidi.ring$eval36604$fn__36605$G__36595__36614.invoke(ring.clj:12)\n\tat puppetlabs.puppetdb.middleware$eval37916$make_pdb_handler__37925$fn__37928$fn__37930.invoke(middleware.clj:336)\n\tat puppetlabs.puppetdb.middleware$wrap_with_illegal_argument_catch$fn__37811.invoke(middleware.clj:99)\n\tat puppetlabs.puppetdb.middleware$verify_accepts_content_type$fn__37815.invoke(middleware.clj:114)\n\tat puppetlabs.puppetdb.middleware$verify_content_type$fn__37827.invoke(middleware.clj:147)\n\tat puppetlabs.puppetdb.middleware$wrap_with_metrics$fn__37843$fn__37852.invoke(middleware.clj:239)\n\tat puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__35456$fn__35457$fn__35458.invoke(metrics.clj:14)\n\tat puppetlabs.puppetdb.utils.metrics.proxy$java.lang.Object$Callable$7da976d4.call(Unknown Source)\n\tat com.codahale.metrics.Timer.time(Timer.java:101)\n\tat puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__35456$fn__35457.invoke(metrics.clj:14)\n\tat puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__35456$fn__35457$fn__35458.invoke(metrics.clj:14)\n\tat puppetlabs.puppetdb.utils.metrics.proxy$java.lang.Object$Callable$7da976d4.call(Unknown Source)\n\tat com.codahale.metrics.Timer.time(Timer.java:101)\n\tat puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__35456$fn__35457.invoke(metrics.clj:14)\n\tat puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__35456$fn__35457$fn__35458.invoke(metrics.clj:14)\n\tat puppetlabs.puppetdb.utils.metrics.proxy$java.lang.Object$Callable$7da976d4.call(Unknown Source)\n\tat com.codahale.metrics.Timer.time(Timer.java:101)\n\tat puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__35456$fn__35457.invoke(metrics.clj:14)\n\tat puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__35456$fn__35457$fn__35458.invoke(metrics.clj:14)\n\tat puppetlabs.puppetdb.utils.metrics.proxy$java.lang.Object$Callable$7da976d4.call(Unknown Source)\n\tat com.codahale.metrics.Timer.time(Timer.java:101)\n\tat puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__35456$fn__35457.invoke(metrics.clj:14)\n\tat puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_.invokeStatic(metrics.clj:17)\n\tat puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_.invoke(metrics.clj:6)\n\tat puppetlabs.puppetdb.middleware$wrap_with_metrics$fn__37843.invoke(middleware.clj:238)\n\tat puppetlabs.puppetdb.middleware$wrap_with_globals$fn__37806.invoke(middleware.clj:93)\n\tat puppetlabs.puppetdb.http.server$build_app$fn__39459.invoke(server.clj:74)\n\tat compojure.core$routing$fn__24407.invoke(core.clj:151)\n\tat clojure.core$some.invokeStatic(core.clj:2592)\n\tat clojure.core$some.invoke(core.clj:2583)\n\tat compojure.core$routing.invokeStatic(core.clj:151)\n\tat compojure.core$routing.doInvoke(core.clj:148)\n\tat clojure.lang.RestFn.invoke(RestFn.java:423)\n\tat puppetlabs.puppetdb.pdb_routing$wrap_with_context$fn__50264.invoke(pdb_routing.clj:35)\n\tat compojure.core$if_context$fn__24469.invoke(core.clj:218)\n\tat compojure.core$routing$fn__24407.invoke(core.clj:151)\n\tat clojure.core$some.invokeStatic(core.clj:2592)\n\tat clojure.core$some.invoke(core.clj:2583)\n\tat compojure.core$routing.invokeStatic(core.clj:151)\n\tat compojure.core$routing.doInvoke(core.clj:148)\n\tat clojure.lang.RestFn.applyTo(RestFn.java:139)\n\tat clojure.core$apply.invokeStatic(core.clj:648)\n\tat clojure.core$apply.invoke(core.clj:641)\n\tat compojure.core$routes$fn__24411.invoke(core.clj:156)\n\tat compojure.core$routing$fn__24407.invoke(core.clj:151)\n\tat clojure.core$some.invokeStatic(core.clj:2592)\n\tat clojure.core$some.invoke(core.clj:2583)\n\tat compojure.core$routing.invokeStatic(core.clj:151)\n\tat compojure.core$routing.doInvoke(core.clj:148)\n\tat clojure.lang.RestFn.invoke(RestFn.java:460)\n\tat puppetlabs.puppetdb.pdb_routing$pdb_app$fn__50275.invoke(pdb_routing.clj:62)\n\tat compojure.core$if_context$fn__24469.invoke(core.clj:218)\n\tat puppetlabs.pe_puppetdb_extensions.sync.pe_routing$wrap_cert_and_token_authn$fn__52846.invoke(pe_routing.clj:64)\n\tat puppetlabs.rbac_client.middleware.authentication$wrap_token_access_STAR_$fn__52716.invoke(authentication.clj:73)\n\tat ring.middleware.params$wrap_params$fn__35556.invoke(params.clj:64)\n\tat puppetlabs.puppetdb.middleware$wrap_with_certificate_cn$fn__37796.invoke(middleware.clj:75)\n\tat puppetlabs.puppetdb.middleware$wrap_with_default_body$fn__37801.invoke(middleware.clj:82)\n\tat puppetlabs.puppetdb.middleware$wrap_with_debug_logging$fn__37779.invoke(middleware.clj:39)\n\tat puppetlabs.i18n.core$locale_negotiator$fn__124.invoke(core.clj:357)\n\tat puppetlabs.trapperkeeper.services.webserver.jetty9_core$ring_handler$fn__44592.invoke(jetty9_core.clj:434)\n\tat puppetlabs.trapperkeeper.services.webserver.jetty9_core.proxy$org.eclipse.jetty.server.handler.AbstractHandler$ff19274a.handle(Unknown Source)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:205)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)\n\tat org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:219)\n\tat org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)\n\tat org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:724)\n\tat org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:56)\n\tat com.puppetlabs.trapperkeeper.services.webserver.jetty9.utils.MDCRequestLogHandler.handle(MDCRequestLogHandler.java:36)\n\tat org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:169)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)\n\tat org.eclipse.jetty.server.Server.handle(Server.java:531)\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)\n\tat org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)\n\tat java.lang.Thread.run(Thread.java:748)\n{code}\n*Related queries*\n\nSimilar queries that search for a non-null fact match return the expected responses:\n{code}[root@pe-201817-master centos]# curl -sX GET http://localhost:8080/pdb/query/v4/nodes --data-urlencode 'query=[\"=\", [\"fact\", \"id\"], \"toot\"]' | python -m json.tool\n\n[]\n\n[root@pe-201817-master centos]# curl -sX GET http://localhost:8080/pdb/query/v4/nodes --data-urlencode 'query=[\"=\", [\"fact\", \"id\"], \"root\"]' | python -m json.tool\n\n[\n {\n \"cached_catalog_status\": \"not_used\",\n \"catalog_environment\": null,\n \"catalog_timestamp\": null,\n \"certname\": \"pe-201817-master.platform9.puppet.net\",\n \"deactivated\": null,\n \"expired\": null,\n \"facts_environment\": \"production\",\n \"facts_timestamp\": \"2019-03-13T20:05:12.348Z\",\n \"latest_report_corrective_change\": false,\n \"latest_report_hash\": \"47ed1c9acbc4e63b7548e018ee266abc2affdbe9\",\n \"latest_report_job_id\": null,\n \"latest_report_noop\": false,\n \"latest_report_noop_pending\": false,\n \"latest_report_status\": \"failed\",\n \"report_environment\": \"production\",\n \"report_timestamp\": \"2019-03-13T20:05:14.836Z\"\n }\n]\n{code}\nQueries that search for a \"null?\" match on non-facts also return the expected responses:\n{code}[root@pe-201817-master centos]# curl -sX GET http://localhost:8080/pdb/query/v4/nodes --data-urlencode 'query=[\"null?\", \"certname\", true]' | python -m json.tool\n\n[]\n\n[root@pe-201817-master centos]# curl -sX GET http://localhost:8080/pdb/query/v4/nodes --data-urlencode 'query=[\"null?\", \"certname\", false]' | python -m json.tool\n\n[\n {\n \"cached_catalog_status\": \"not_used\",\n \"catalog_environment\": null,\n \"catalog_timestamp\": null,\n \"certname\": \"pe-201817-master.platform9.puppet.net\",\n \"deactivated\": null,\n \"expired\": null,\n \"facts_environment\": \"production\",\n \"facts_timestamp\": \"2019-03-13T20:05:12.348Z\",\n \"latest_report_corrective_change\": false,\n \"latest_report_hash\": \"47ed1c9acbc4e63b7548e018ee266abc2affdbe9\",\n \"latest_report_job_id\": null,\n \"latest_report_noop\": false,\n \"latest_report_noop_pending\": false,\n \"latest_report_status\": \"failed\",\n \"report_environment\": \"production\",\n \"report_timestamp\": \"2019-03-13T20:05:14.836Z\"\n }\n]\n{code}", "epicLinkSummary": null, "estimate": "PT0S", "externalId": "51696", "fixedVersions": [], "id": "51696", "issueType": "Bug", "key": "PDB-4305", "labels": ["known-issue-added", "query-engine-improvements"], "originalEstimate": "PT0S", "parent": null, "parentSummary": null, "priority": "Low (migrated)", "projectDescription": "

PuppetDB Project

", "projectKey": "PDB", "projectLead": "70121:4c2994e4-73a9-4e99-971a-6d93d39be223", "projectName": "PuppetDB (Archived)", "projectType": "software", "projectUrl": null, "reporter": "557058:836ef76e-8051-48a3-8dc7-005f79695b0e", "status": "Accepted", "statusCategory": "To Do", "statuscategorychangedate": "11/Mar/23 10:10 AM", "summary": "\"null?\" query of facts against the query/v4/nodes endpoint results in \"Value does not match schema\" errors", "timeSpent": "PT0S", "updated": "2022-02-10T07:33:00.000000", "votes": "2", "watchers": []}, {"affectedVersions": [], "assignee": "557058:3915718f-2673-45b3-a0a6-c7c03ef0754e", "attachments": [], "comments": [{"author": "557058:0a2bfc9c-1912-49b1-9776-665ef20c8769", "body": "[~accountid:5b0340d43eafdb09dee5bc3a] see also DOC-3976 (same reporter)", "created": "2019-03-13T13:24:00.000000"}], "components": ["PuppetDB"], "created": "2019-03-13T13:23:00.000000", "creator": "557058:0a2bfc9c-1912-49b1-9776-665ef20c8769", "customFieldValues": [{"fieldName": "Sub-team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Approvals", "fieldType": "com.atlassian.servicedesk.approvals-plugin:sd-approvals", "value": "com.atlassian.servicedesk.plugins.approvals.internal.customfield.ApprovalsCFValue@32180791"}, {"fieldName": "Epic/Theme", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:labels", "value": []}, {"fieldName": "Capitalized?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Yes"}, {"fieldName": "Epic Link", "fieldType": "com.pyxis.greenhopper.jira:gh-epic-link", "value": "PDB-4759"}, {"fieldName": "People Involved", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multiuserpicker", "value": []}, {"fieldName": "Flagged", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes", "value": []}, {"fieldName": "Free ?", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons", "value": "Yes"}, {"fieldName": "Method Found", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "QA Risk Assessment", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Needs Assessment"}, {"fieldName": "Rank", "fieldType": "com.pyxis.greenhopper.jira:gh-lexo-rank", "value": "0|hylbhr:"}, {"fieldName": "Release Notes", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "Not Needed"}, {"fieldName": "Scrum Team", "fieldType": "com.atlassian.jira.plugin.system.customfieldtypes:select", "value": "PuppetDB"}, {"fieldName": "[CHART] Date of First Response", "fieldType": "com.atlassian.jira.ext.charting:firstresponsedate", "value": "13/Mar/19"}, {"fieldName": "[CHART] Time in Status", "fieldType": "com.atlassian.jira.ext.charting:timeinstatus", "value": "1_*:*_1_*:*_5403_*|*_10007_*:*_1_*:*_1272222288_*|*_5_*:*_1_*:*_0_*|*_10006_*:*_1_*:*_10720203142_*|*_10005_*:*_2_*:*_33529208870"}], "description": "[https://puppet.com/docs/puppetdb/6.2/install_from_packages.html].\n\nUrl: /docs/puppetdb/6.2/install_from_packages.html\nRank: 1/5\nMessage:\n\"enable the Puppet Collection package repository\" links to a 404, aka this\ndoes not exist: \"[https://docs.puppet.com/puppet/6.4/puppet_collections.html]\",\nand in another place it lists this as \"Puppet Platform package repository\".\nWhat is the difference between \"Puppet Platform package repository\" and\n\"Puppet Collection package repository\"?\u00a0 Frankly what is Puppet Platform and\nwhat is Puppet Collection?\u00a0 I have used puppet for 7 years, and am updating\nto puppet 6 from 2.7, this does not make sense to a user with 7 years of old\npuppet experience.", "epicLinkSummary": "Improvements to PuppetDB's Documentation", "estimate": "PT0S", "externalId": "52613", "fixedVersions": ["PDB n/a"], "id": "52613", "issueType": "Bug", "key": "PDB-4304", "labels": ["docs-pdb", "feedback-form-docs-site"], "originalEstimate": "PT0S", "parent": "50600", "parentSummary": "Improvements to PuppetDB's Documentation", "priority": "Normal", "projectDescription": "