MQTT V5 Protocol support

Is your feature request related to a problem? Please describe.
It is not a problem, I just see MQTT protocol is not define in mqtt client code, so I guess it uses v3.
Describe the solution you'd like
I think it would be an enhancement if MQTT v5 is supported, as it comes with many interesting features.
Describe alternatives you've considered
n/a
Additional context
n/a
I understand that for compatibility, MQTT v3 is the default protocol version, I just think adding support to V5 would be a nice to have feature.

Can I ask you why? I mean I could use mqtt v5 protocol without any problem, it's just a connection parameter, but wondering what specific feature of mqtt5 you are looking for here

In MQTT v5 you can manage persistent connection in a more efficient way, for example defining MQTT 5’s Session Expiry Interval.
It is just an enhancement that I think might be interesting.

Yeah I know all the MQTTv5 features very well, I'm just curious what in detail you would like to be configurable from settings.
I mean setting the protocol to v5 is easy as mqttjs already supports that but that alone doesn't give you any advantages, when that is selected I should allow you to set session expiry or what else feature you want to use

By the way, about MQTT version, I am not sure if zwave-js-ui uses v3.1 or v.3.1.1
If it is 3.1, there are some brokers that does not support it any more.
Do you know which version is used?

It uses 3.1.1 by default as documented here: https://github.com/mqttjs/MQTT.js#important-notes-for-existing-users
(very old breaking change BTW before 2.0 version)

Another breaking change is that MQTT.js now defaults to MQTT v3.1.1, so to support old brokers, please read the client options doc.

Thanks for the info.

For MQTT V5 I would like to utilize the possibility of adding metadata to the messages pr. device ID by userProperty. In addition to the excellent possibilities to customice topics by name and location. Here is an exampel:
msg.properties = {
   userProperties: {
       "manufacturer": "heatit",
       "product": "multipurpose_relay",
       "tfm": "=5640.002.001%KXZ.001.005"
       };
}

Regards Arne-Olaf


Improve USWDS alert styles

Allows alerts to be a better color, not have a header text, use
our color for the icon, and not have top margin.

I've checked out the docs site and the landing site and it looks like this is our first alert usage so it won't be a breaking change.
I'll go ahead and rebase the branch and merge.


Adding expression(regEx) to query

In Step 1: Create a data source:
Can i add  an expression like /cv/.* in query or it has to be a relative path.
I mean in container >> query

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: b32a534c-4c64-3e08-824a-cd298cd43022
Version Independent ID: c0a0ac07-8e05-011f-ee31-e063854f3162
Content: Indexing JSON blobs with Azure Search blob indexer
Content Source: articles/search/search-howto-index-json-blobs.md
Service: search
GitHub Login: @mgottein
Microsoft Alias: magottei

@ajamaeen We will close this as a duplicate to the original issue filed: https://github.com/MicrosoftDocs/azure-docs/issues/17305


fix for breaking change in liveview router

After this fix surface_catalogue compiles with the latest Phoenix version, but we're still having an issue with our catalogue views:
** (UndefinedFunctionError) function Bonfire.UI.Social.Activity.ActionsLive.__gets_context__?/0 is undefined or private. Did you mean one of:

      * __get_slot__/1
      * __use_context__?/0

    (bonfire_ui_social 0.1.0) Bonfire.UI.Social.Activity.ActionsLive.__gets_context__?()
    (surface 0.5.2) lib/surface/compiler/eex_engine.ex:259: Surface.Compiler.EExEngine.to_expression/3
    (surface 0.5.2) lib/surface/compiler/eex_engine.ex:61: Surface.Compiler.EExEngine.generate_buffer/3
    (surface 0.5.2) lib/surface/compiler/eex_engine.ex:31: Surface.Compiler.EExEngine.translate/2
    (surface 0.5.2) expanding macro: Surface.sigil_F/2
    priv/catalogue/surface/components/actions/actions.ex:10: Bonfire.UI.Social.Components.Actions.render/1
    expanding macro: Bonfire.UI.Social.Components.Actions.sigil_F/2
    priv/catalogue/surface/components/actions/actions.ex:10: Bonfire.UI.Social.Components.Actions.render/1
    (elixir 1.12.1) lib/kernel/parallel_compiler.ex:319: anonymous fn/4 in Kernel.ParallelCompiler.spawn_workers/7

@mayel thanks for the PR! Can you please try the version on master and see if you still get this error?

Thanks, I'll give it a go!


Add casperholders domains to the manifest

This PR adds the two domains names for the casperholders application which interact with CasperSigner.
I have made a proposal to have a grant from DEVxDAO to publish the full code source of the application (https://portal.devxdao.com/public-proposals/72).
Currently, is closed source but as soon as this PR is merged and the last features are done I'll release the full source code on the same repository.
The application will enable users to delegate / undelegate and see current balance between staked tokens and available tokens. (With more features to come for the validators).
The review of the application has been done with the Casper Dev Team (Thu Jul 1, 2021 1pm – 2pm) on Zoom.

Hey @George-cl can you confirm that this PR will be included with the 1.3 Release ? 🙏

Hey @George-cl can you confirm that this PR will be included with the 1.3 Release ?

Hi @KillianH, I believe someone will be reaching out to you to complete KYC (a pre-requisite for integration). Once completed (in time for 1.3.0), I'll merge in your PR and you should be good to go.
Really appreciate your patience with the process and interest in the project!
If there's anything I can help with feel free to reach out :smile:

Hey @George-cl can you confirm that this PR will be included with the 1.3 Release ?

Hi @KillianH, I believe someone will be reaching out to you to complete KYC (a pre-requisite for integration). Once completed (in time for 1.3.0), I'll merge in your PR and you should be good to go.
Really appreciate your patience with the process and interest in the project!
If there's anything I can help with feel free to reach out 😄

Yep I received the mail from Medha directly :) I'll keep you updated here.

Hey @George-cl can you confirm that this PR will be included with the 1.3 Release ?

Hi @KillianH, I believe someone will be reaching out to you to complete KYC (a pre-requisite for integration). Once completed (in time for 1.3.0), I'll merge in your PR and you should be good to go.
Really appreciate your patience with the process and interest in the project!
If there's anything I can help with feel free to reach out 😄

Yep I received the mail from Medha directly :) I'll keep you updated here.

KYC done ✅ @George-cl so this can be merge when you want from now 🤟

That's great @KillianH, I'll get this into the 1.3.0 release - exciting!


Can you make reIntroduceZeroTickFarms run at 1.17.1?

I want reIntroduceZeroTickFarms to be able to run at 1.17.1,but the latest 1.17.1 mod version doesn't have this feature.

Sorry I'm not maintaining that version at the moment. So I won't be doing that anytime soon


This requires the following changes:

make Gossip.GossipBroadcast operate on GossipData. We need this so we can perform accumulation (see below). It also gives the opportunity to update data as we relay it, which is an optimisation.
add "representation of received update" to return of Peers.ApplyUpdate. We need this so we can perform the aforementioned data updating for when relaying topology gossip.
use GossipSenders for GossipBroadcast. Depends on 1. We need this so GossipBroadcast becomes properly async, which is required if we want to use it for topology gossip - in order to avoid deadlocks w/o spawning a unbounded number of goroutines. It is also a great optimisation since GossipData is accumulated and sent in one go. Note that there is one GossipSender per broadcast source since that is the largest granularity at which accumulation is possible. As with the existing GossipSenders, we need a way to GC stale entries - in this case for broadcast source peers that have disappeared.
introduce Routes.EnsureRecalculated. We need this so that when topology gossip uses GossipBroadcast, we ensure the broadcast routes are up to date wrt the latest topology.
Switch to use Gossip.GossipBroadcast for topology updates. Depends on 1,2,3,4.

Closes #514.

Coverage increased (+2.03%) to 37.16% when pulling 6a24f663fe836ce7d88f370cf0bb3dccb357039d on rade:514_lower_topology_gossip_complexity into 8c1015d2a47b4f88d61d1bf9552e10052115b27d on zettio:master.

@bboreham would you mind taking a look at this?
The individual commits are self-contained, modulo the dependencies as indicated, so I recommend reviewing them individually. We could also merge them into master individually, if that is helpful. 2+4 are behaviour preserving when merged into master. 1 is an API change that doesn't affect master, but probably does affect IPAM. 3 doesn't affect behaviour on master, and should be an optimisation for IPAM. Only 5 affects the behaviour on master.

Coverage increased (+2.22%) to 37.35% when pulling 7362efb8aa60501f4e1e9fed0af7bfc561a05fbd on rade:514_lower_topology_gossip_complexity into 8c1015d2a47b4f88d61d1bf9552e10052115b27d on zettio:master.

Coverage increased (+2.2%) to 37.35% when pulling c877ec22dafcf3d181d3dee8f126aba62d61e16e on rade:514_lower_topology_gossip_complexity into 80aa60b3ab0f5793e945073bfd25a478647a88b3 on zettio:master.

Coverage remained the same at 37.22% when pulling 773fa17d9b85f9125128263ccdbe63aceb208b9d on rade:514_lower_topology_gossip_complexity into 6f2f25aca534e649bd380d5dfa6a206992a46c46 on zettio:master.

Coverage increased (+2.38%) to 37.53% when pulling 808e8d0ffb34ab01f26ef49775bf4d25e04bb69b on rade:514_lower_topology_gossip_complexity into 6f2f25aca534e649bd380d5dfa6a206992a46c46 on zettio:master.

Coverage increased (+2.16%) to 37.25% when pulling f80410bf59312259ba18fd91cccc4e3d31fa14d8 on rade:514_lower_topology_gossip_complexity into 9b9d8a03aa158b9738a1b4e23abd25095eeb8ea0 on zettio:master.

"It also ensures we update data as we relay it" - there is nothing in the code to ensure any updating of data, nor any mention in the comment on OnBroadcastUpdate() .
"It gives the opportunity to update data as we relay it" seems more accurate.

Actually, I see that the updating will fall out from the natural usage of GossipData.


sysctl command not allowed in host network namespace: unknown

Hi there,
We run into an issue with docker on latest/edge channel. A sysctl command will run in the container using host network. Here is the API log from Docker:
msg="Handler for POST /containers/8483159eeddf0962ea101db60eb26b787a2498147ab494cb2da96c9b289bff9d/start returned error: OCI runtime create failed: sysctl xxxx not allowed in host network namespace: unknown"

This issue was resolved after we installed docker from latest/stable channel.
The current versions of Docker snap:

latest/edge: 19.03.13
latest/edge: 20.10.6

Thanks,
Hao

May add more contexts from logs before hitting the unknown error:
  3 msg="starting signal loop" namespace=moby path=/run/snap.docker/containerd/daemon/io.containerd.runtime.v2.task/moby/be3637046c8df9b8daa69169df5a2e29a1abbf5e2b656aabd63d406aae310fb2 pid=562
  2 msg="copy shim log" error="read /proc/self/fd/12: file already closed"
  1 msg="stream copy error: reading from a closed fifo"
4   msg="stream copy error: reading from a closed fifo"
  1 msg="be3637046c8df9b8daa69169df5a2e29a1abbf5e2b656aabd63d406aae310fb2 cleanup: failed to delete container from containerd: no such container"
  2 msg="Handler for POST /containers/be3637046c8df9b8daa69169df5a2e29a1abbf5e2b656aabd63d406aae310fb2/start returned error: OCI runtime create failed: sysctl xxxx not allowed in host network namespace: unknown"

Hi @tianon, we got the errors from Docker API. It seems it is a new issue, https://github.com/moby/moby/issues/28821#issuecomment-814208448. We are using the version of Ubuntu docker snap, 20.10.6 916, on latest/beta channel.

It seems this is the new bug, https://github.com/moby/moby/issues/42288.

Ah!  In that case, once the GitHub Actions on https://github.com/docker-snap/docker-snap/pull/41 finish, there'll be a docker.snap artifact you can download and test to verify it fixes your issue.


double quotes in ingestion config lead to incorrect lineage for Looker dashboards / charts

Describe the bug
Given an ingestion recipe like the following:
source:
  type: "looker"
  config:
    client_id: ${LOOKER_CLIENT_ID}
    client_secret: ${LOOKER_CLIENT_SECRET}
    base_url: ${LOOKER_API_URL}
    platform_name: "looker"
    actor: "urn:li:corpuser:etl"
    env: "PROD"

sink:
  type: "datahub-kafka"
  config:
     ... all the typical kafka config stuff ...

datahub ingest creates Metadata Change Event (MCE) messages for Looker charts with input URNs that are unlikely to match the URNs of the corresponding datasets those charts rely on.

chart MCE input: urn:li:dataset:(urn:li:dataPlatform:str = \"looker\",some_dataset,PROD)
dataset MCE URN: urn:li:dataset:(urn:li:dataPlatform:looker,some_dataset,PROD)

To Reproduce
I've been struggling to create a simple reproducible example of this, which makes me suspect that the issue might not be happening in load_config_file() but somewhere between that and running the ingestion.
Using pip install 'acryl-datahub[looker,datahub-kafka]==<IP_ADDRESS>'.
output of `conda info` (click me)

     active environment : pycharm-repos
    active env location : /Users/James.Lamb/miniconda3/envs/pycharm-repos
            shell level : 1
       user config file : /Users/James.Lamb/.condarc
 populated config files :
          conda version : 4.10.1
    conda-build version : not installed
         python version : 3.8.5.final.0
       virtual packages : __osx=10.16=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : /Users/James.Lamb/miniconda3  (writable)
      conda av data dir : /Users/James.Lamb/miniconda3/etc/conda
  conda av metadata url : https://repo.anaconda.com/pkgs/main
           channel URLs : https://repo.anaconda.com/pkgs/main/osx-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/osx-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /Users/James.Lamb/miniconda3/pkgs
                          /Users/James.Lamb/.conda/pkgs
       envs directories : /Users/James.Lamb/miniconda3/envs
                          /Users/James.Lamb/.conda/envs
               platform : osx-64
             user-agent : conda/4.10.1 requests/2.25.1 CPython/3.8.5 Darwin/20.5.0 OSX/10.16
                UID:GID : 504:20
             netrc file : None
           offline mode : False

Given a config like this
source:
  type: "looker"
  config:
    client_id: ${LOOKER_CLIENT_ID}
    client_secret: ${LOOKER_CLIENT_SECRET}
    base_url: ${LOOKER_API_URL}
    platform_name: "looker"
    actor: "urn:li:corpuser:etl"
    env: "PROD"

load_config_file() produces the values I'd expect.
from datahub.configuration.config_loader import load_config_file
import os

for env_var in ["LOOKER_CLIENT_ID", "LOOKER_CLIENT_SECRET", "LOOKER_API_URL"]:
    os.environ[env_var] = "abc"

load_config_file("test.yaml")

# {'source': {'type': 'looker', 'config': {'client_id': 'abc', 'client_secret': 'abc', 'base_url': 'abc', 'platform_name': 'looker', 'actor': 'urn:li:corpuser:etl', 'env': 'PROD'}}}

However, using datahub ingest -c $(pwd)/test.yaml, I see messages produced with the wrong URN (that str = \"looker\" thing mentioned above).
If I remove the quotes in the config, the URNs look how I'd expect them to.
Expected behavior
I expected that double quotes in recipe YAML files would not be interpreted as string literals. In other words, I expected that platform_name: "looker" and platform_name: looker would resolve to identical values.
Screenshots
N/A
Desktop (please complete the following information):
Observed on macOS and in a docker container using the python:3.7-slim image.
Additional context

YAML 1.1 (the version used by PyYAML, which this project uses), docs on double-quoted scalar values: https://yaml.org/spec/current.html#double quoted style/syntax
while trying to reproduce this, I traced out the path of how a recipe value makes it into the code creating MCE messages. Pasting that below in case it's helpful.

code path from MCE message generation backwards to when the config file is loaded (click me)

which is passed a platform_name from the config passed into LookerDashboardSource (https://github.com/linkedin/datahub/blob/84a1486b89d683ef96b2f665583125e2b7089969/metadata-ingestion/src/datahub/ingestion/source/looker.py#L315)
that LookerDashboardSourceConfig's source is at https://github.com/linkedin/datahub/blob/84a1486b89d683ef96b2f665583125e2b7089969/metadata-ingestion/src/datahub/ingestion/source/looker.py#L315
that instance of LookerDashboardSource is created by the Pipeline constructor, at https://github.com/linkedin/datahub/blob/84a1486b89d683ef96b2f665583125e2b7089969/metadata-ingestion/src/datahub/ingestion/run/pipeline.py#L71
that gets its config dict from PipelineConfig.pars_obj() in Pipeline.create(), here: https://github.com/linkedin/datahub/blob/84a1486b89d683ef96b2f665583125e2b7089969/metadata-ingestion/src/datahub/ingestion/run/pipeline.py#L102
which is created here in the ingest entrypoint, https://github.com/linkedin/datahub/blob/84a1486b89d683ef96b2f665583125e2b7089969/metadata-ingestion/src/datahub/entrypoints.py#L79
that config is loaded with datahub.configuration.config_loader.load_config_file(), at https://github.com/linkedin/datahub/blob/84a1486b89d683ef96b2f665583125e2b7089969/metadata-ingestion/src/datahub/entrypoints.py#L75
which will use datahub.configuration.yaml.YamlConfigurationMechanism.load_config(), https://github.com/linkedin/datahub/blob/84a1486b89d683ef96b2f665583125e2b7089969/metadata-ingestion/src/datahub/configuration/config_loader.py#L12
which will use yaml.safe_load(), at https://github.com/linkedin/datahub/blob/84a1486b89d683ef96b2f665583125e2b7089969/metadata-ingestion/src/datahub/configuration/yaml.py#L12

where yaml is PyYAML

This is quite odd
When you run with datahub --debug ingest ..., it should dump the config that it loaded prior to validation - could you paste that log line here as well?

This is quite odd
When you run with datahub --debug ingest ..., it should dump the config that it loaded prior to validation - could you paste that log line here as well?

sure! I did that this morning. For a recipe with platform_name: "looker", I don't see anything problematic in the config. (I added the "REDACTED"s below).

[2021-07-23 14:56:07,972] DEBUG    {datahub.entrypoints:78} - Using config: {'source': {'type': 'looker', 'config': {'client_id': 'REDACTED', 'client_secret': 'REDACTED', 'base_url': 'REDACTED', 'platform_name': 'looker', 'actor': 'urn:li:corpuser:etl', 'env': 'PROD'}}, 'sink': {'type': 'datahub-kafka', 'config': {'connection': {'bootstrap': 'REDACTED', 'producer_config': {'security.protocol': 'SSL', 'ssl.ca.location': '/etc/service/keys/ca', 'ssl.certificate.location': '/etc/service/keys/cert', 'ssl.key.location': '/etc/service/keys/key'}, 'schema_registry_url': 'REDACTED', 'schema_registry_config': {'basic.auth.user.info': 'REDACTED'}}}}}

I also noticed that the MCE messages produced now have the expected URN structure.
"inputs": {
  "array": [
    {
      "string": "urn:li:dataset:(urn:li:dataPlatform:looker,reporting_market,PROD)"
    },
    {
      "string": "urn:li:dataset:(urn:li:dataPlatform:looker,sfdc_case,PROD)"
    },
    {
      "string": "urn:li:dataset:(urn:li:dataPlatform:looker,rental,PROD)"
    }
  ]
}

Since I can't reproduce this, I think it's ok to close it. Sorry for the noise 😕

Closing as this seems to have been resolved now.


Generated 2.18 version and added upgrade instructions

Site is not updated yet by the way. Also, documentation URL with v2.16 and latest works, but v2.17 (and v2.18 of course) were not generated: maybe this can should be fixed before updating latest?


Feature request: optionally show position of 'viewers' on map

First of all thanks for sharing this great project!
From the 'viewer' point of view it would be nice to see not only the shared location but the own position (if available) as well.
Another idea: is it much work to integrate this into nextcloud as an app?

Thanks a lot for your feedback!

From the 'viewer' point of view it would be nice to see not only the shared location but the own position (if available) as well.

This is planned, but I don't know exactly when I can get back to it. I'll leave this issue open until I've managed to implement it.

Another idea: is it much work to integrate this into nextcloud as an app?

This will not happen, unfortunately. Hauk was made to be independent from other applications; in fact one of the reasons I made this was to get a non-Nextcloud alternative for PhoneTrack. There's not really any obvious purpose that I can see to have this integrated with Nextcloud. That said, go check out PhoneTrack, that might be what you need. :-)

One good reason to integrate it with some third parties is user authentication. So far you managed to avoid this topic. It is good decision for now. But eventually users and user authentication will show up

I'll leave that as a future concern for now. Since this project is meant to be self-hosted, chances are there will be very few users using each instance, all of them likely in the admin's circle of friends. At least for now, a static password should be sufficient for that purpose.
However, if there is need for it, instead of going through third party OAuth logins, I could consider adding htaccess-like authentication later. That would necessitate having a "username" field in the app, however. Not sure how I can solve that now, but I can cross that bridge when I come to it if this becomes a wanted feature later.

Actually, there are multiple other services to self-host where user-authentification is needed already. I like  Hauk because nothing like that is needed. I can show it to my friends and if they have the app and the password they can use it without creating an extra user.
The "show my own position as viewer" wold be nice but i don't know if that is possible with the browser.

Another idea: is it much work to integrate this into nextcloud as an app?

This will not happen, unfortunately. Hauk was made to be independent from other applications; in fact one of the reasons I made this was to get a non-Nextcloud alternative for PhoneTrack. There's not really any obvious purpose that I can see to have this integrated with Nextcloud. That said, go check out PhoneTrack, that might be what you need. :-)

That's plausible, thanks anyway.

From the 'viewer' point of view it would be nice to see not only the shared location but the own position (if available) as well.

This is planned, but I don't know exactly when I can get back to it. I'll leave this issue open until I've managed to implement it.

What I found so far is this
My programming skills are not good enough to write a solution for a PR, unfortunately. Sorry

Yes, its possible. https://www.w3schools.com/html/html5_geolocation.asp

This has now been implemented. There is a geolocation control that will display and center the map on the user. The viewer gets a blue marker instead of a red one. Clicking the control again will hide the viewer from the map.
Due to browser security, geolocation of the map viewer only works on HTTPS.

Thank you very much for implementing this feature!!!
Already tested and it's working flawlessly :1st_place_medal:


how use crawl4ai to crawl page content that need login firstly?

Hello,
I don`t find right way to work such case,as the web I need crawl will jump to login page and later after login will turn to content page.
Here is my test code, but not work.  Would you give me one hand?
from playwright.async_api import async_playwright
from crawl4ai import AsyncWebCrawler
import asyncio

async def login_and_get_page(browser):
    context = await browser.new_context(viewport={'width': 1920, 'height': 1080})
    page = await context.new_page()

    await page.goto('https://sample.com')
    await page.fill('input[name="USER"]', '123')
    await page.fill('input[name="PASSWORD"]', '123')
    await page.click('input[type="submit"]')

    title = await page.title()
    print(f"title: {title}")
    print("login pass")
    return page

async def main():
    print("[HOOK] on_browser_created")

    async with async_playwright() as p:
        browser = await p.chromium.launch(headless=False)  # 设置 headless=False 以可视化浏览器
        page = await login_and_get_page(browser)

        # 获取登录后页面的 cookies
        cookies = await page.context.cookies()
        print(cookies)
        # 使用 Crawl4AI 爬取页面内容
        async with AsyncWebCrawler(verbose=True, cookies=cookies, headless=False, magic=True) as crawler:
            result = await crawler.arun(
                url="https://sample.com",
            )
        print(result.markdown)

asyncio.run(main())

I found the solution by add my login code into
async_crawler_strategy.py -->  async def crawl(self, url: str, **kwargs) -> AsyncCrawlResponse:
after page = await context.new_page()
await page.goto(url)
await page.fill('input[name="USER"]', 'nnn')
await page.fill('input[name="PASSWORD"]', 'xx')
await page.click('input[type="submit"]')
title = await page.title()
print(f"PAGE title: {title}")
print("login pass")

@kksasa  Thx for using Crawl4ai. Here's a condensed version of the message:
I believe you're using our library with Playwright in an unintended way. Our library is designed to simplify tasks, and you can achieve most of what you're doing without Playwright. We have features like webhooks, page access, and JavaScript execution that can help.
For example, you can use our "Managed Browsers" feature (coming in a new version) to create a browser session with a pre-logged-in user. Alternatively, you can use our hooks to run JavaScript before crawling, such as filling out a login form and waiting for elements to load.
I'd be happy to provide a simple example of how to use our library effectively. I will add this to my backlog, to create a demo for this and the content, perhaps, and explain how you can do that. Please stay tuned.

can we pass through cookies to the crawl rest API endpoint so it can be logged in?

@rdvo are you referring to when you are using Crawl4ai from the running Doctor server? Is that what you mean by the 'Rest API endpoint'? If yes, the answer is yeah, you can pass the cookies definitely. For example you can pass like this:
request = {
        "urls": "https://www.nbcnews.com/business",
        "priority": 8,
        "js_code": [
            "const loadMoreButton = Array.from(document.querySelectorAll('button')).find(button => button.textContent.includes('Load More')); loadMoreButton && loadMoreButton.click();"
        ],
        "wait_for": "article.tease-card:nth-child(10)",
        "crawler_params": {
            "headless": True, "cookies": [{...}, ..]
        }
    }

yes what are the params there, is it in json format like edithtiscookie chrome addon? what format do we pass them in?
it gets passed as crawler_params options?
Thanks!

@rdvo Sorry for my delay, yes its in json format like {"name": "...", "value": "...", "url": "..."}


Slot queue test fails occasionally

This test fails occasionally (once every 10 runs or so):
https://github.com/codex-storage/nim-codex/blob/1d161d383ec2738cdc3a0eac16e8b0788f218edb/tests/codex/sales/testsales.nim#L178
I couldn't see anything obviously wrong, could you take a look @emizzle?

Locally, in master, I was able to successfully run testsales 20 times with no errors, and make test 10 times with no errors.
There also doesn't seem to be any errors in CI relating to this.
Are you definitely still seeing this error?

It's a tough one to reproduce for some reason. On my older laptop I see the error quite frequently, but on my newer desktop see it much less frequently. I was able to reproduce it on CI as well, but it did not occur as often as I expected: https://github.com/codex-storage/nim-codex/actions/runs/6010028817/job/16300630141?pr=539#step:4:2933
testsales.nim(277, 28): Check failed: eventuallyCheck itemsProcessed.len == request.ask.slots.int

I had to run the test 10000 times :smile:  #539


formatNoMatches doesn't work

Hi, I found tons of thread about this question, maybe it's time to get a definitive answer (that I haven't).
The problem is add a link to the formatNoMatches text that shows a form for adding new items.
I'm stuck at beginning of this problem:  formatNoMatches doesn't work, with this code I still see "No result found", what am I doing wrong? maybe the option is changed in select2 v4?
$("#sel").select2({
     formatNoMatches: function (term) {
            return 'No user matches "' + term + '".
Click here';
        },
        minimumInputLength: 0,
    });

formatNoMatches has become the noMatches key of the language option in 4.0.0, as we have moved that to a new localization section of the options.
You might want to implement your message using tagging though, so you can use a custom template to control what happens when the link is clicked.
http://stackoverflow.com/q/14577014/359284#30021059

Ok this is my simple select2 init, I get an empty string  in case of no results
    $("#decidingbody").select2({
       ajax: {
            url: "/api/dashboard/chambers",
            dataType: 'json',
            delay: 250,
            data: function (params) {
                return {
                    q: params.term,
                };
            },
            processResults: function (data, params) {
                console.log(data)
                var ret = $.map(data.docs, function (obj) {
                    obj.id = obj._id;
                    obj.text = obj.name;

                    return obj;
                });
                return {
                    results: ret
                };
            },
            cache: true
        },
        tags:true,
        createTag: function (params) {
            return false
        },
        templateResult: function (data) {
            var $result = $("");
            $result.text(data.text);
            return $result;
        },
        language: {
            noResults: function() {return "No results Add new value"; }
        },
        escapeMarkup: function (markup) {
            return markup;
        },
        minimumInputLength: 0
    });

It looks like I solved simply removing tags:true, not sure it's a bug or it's just my faulty code.
For tagging I just set the attr "multiple" in the select.

    tags:true,
    createTag: function (params) {
        return false
    },
    templateResult: function (data) {
        var $result = $("");
        $result.text(data.text);
        return $result;
    },
    language: {
        noResults: function() {return "No results Add new value"; }
    },
    escapeMarkup: function (markup) {
        return markup;
    },

Thank you @antonioaltamura for your detailed code example. By using the language and escapeMarkup options, I was able to inject html as desired, but using tags: true even in conjunction with your createTag override breaks (perhaps prevents) the desired effect when using noResults.
Because tags: true is not an option (as explained above), how can I capture the currently entered search term that is prompting the noResults li to be displayed? I tried adding a term parameter (like so: noResults: function(term) { ... }) but I receive an error that term is undefined.


ER_NOT_SUPPORTED_AUTH_MODE

Using MySQL 8.0.12 on a Mac, this error occurs when connecting to a local instance.
ER_NOT_SUPPORTED_AUTH_MODE: Client does not support authentication protocol requested by server; consider upgrading MySQL client.

Try running this on your MySQL client:
ALTER USER '<your_user>'@'localhost' IDENTIFIED WITH mysql_native_password BY '<your_password>';

Try running this on your MySQL client:
ALTER USER '<your_user>'@'localhost' IDENTIFIED WITH mysql_native_password BY '<your_password>';

That worked with me, thank you

Hi all, I am getting this issue too and I apologise I am not too technical.
Please can you help me sort this?
Is MySQL Client the command line?
Also do I copy and paste this word for word - ALTER USER '<your_user>'@'localhost' IDENTIFIED WITH mysql_native_password BY '<your_password>'

Thanks for the help. Here is a link to know more how this works.

great

ALTER USER 'root' IDENTIFIED WITH mysql_native_password BY 'password';
flush privileges;
```

Worked for me!

localhost can be %

Nice.

Thanks a lot, it works!

Thanks a lot!!!!

It works! Thank you!

Worked like a charm!

ALTER USER 'root' IDENTIFIED WITH mysql_native_password BY 'password';
flush privileges;

Worked for me!

Worked for me too!!

Try running this on your MySQL client: ALTER USER '<your_user>'@'localhost' IDENTIFIED WITH mysql_native_password BY '<your_password>';

although this was a few years ago, just wanna thank you for this worked
!

Thanks, It worked for me too

ALTER USER 'root'@'localhost' IDENTIFIED WITH mysql_native_password BY ''; this worked for me.
Thank you

worked for me!!

Try running this on your MySQL client: ALTER USER '<your_user>'@'localhost' IDENTIFIED WITH mysql_native_password BY '<your_password>';

i did this but now i cant connect on mysql workbench to the root connection and it didnt fix the problem for me

Nice one. After typing those commands you need to exit and enter VS again

Thanks you it worked!

That just gets me
ALTER : The term 'ALTER' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of
the name, or if a path was included, verify that the path is correct and try again.
At line:1 char:1
+ ALTER USER 'root' IDENTIFIED WITH mysql_native_password BY 'password'
+ ~~~~~
    + CategoryInfo          : ObjectNotFound: (ALTER:String) [], CommandNotFoundException
    + FullyQualifiedErrorId : CommandNotFoundException

Using Visual Studio's terminal and PowerShell.

this worked for me, mysql running in local docker container:
ALTER USER 'root' IDENTIFIED WITH mysql_native_password BY 'supersecret';

Nice, this works.

Try running this on your MySQL client: ALTER USER '<your_user>'@'localhost' IDENTIFIED WITH mysql_native_password BY '<your_password>';

why?

ALTER USER 'user' IDENTIFIED WITH mysql_native_password BY 'password';
worked for me

@KevinSmild Thank you very much, was struggling to connect from long

This issue was created in 2018.  The solution above is fine temporarily but mysql_native_password is deprecated.
https://blogs.oracle.com/mysql/post/mysql-90-its-time-to-abandon-the-weak-authentication-method
It sounds like this method of password hashing is completely gone in mysql 9.  Is there a long term fix so users of the extension can use SHA2 etc. password hashing?

I've got the same issue using MySQL server instance 9.1.0. Using mysql_native_password plugin is not an option since is already removed since MySQL 9.0.0.


Cookie banner > adds events

To simplify integration with the toggle for form-in-banner implementations (and to simplify other integrations), consider adding custom events:
banner.show
banner.hide
banner.consent

fixed with #223


Fixes bug #7 with python3

It should fix #7, I have tested with python 2 and 3. MispTransportError is only used a couple of times in mispy so it should be ok.
It also keeps compatibility with previous format, so err[2] still works in python2 and err.args[2] and err.status_code work in both python 2 and 3

Sorry using another branch so I can have everything workin in my master branch


changed w.on('log', function (msg) {}) description

I had problems to understand this sentence so I changed it a little to be more understandable.

Thanks!


Adding spin test documentation

Content must go through a pre-merge checklist.
Pre-Merge Content Checklist
This documentation has been checked to ensure that:

[x] The title, template, and date are all set
[x] Does this PR have a new menu item (anywhere in templates/*.hbs files) that points to a document .md that is set to publish in the future? If so please only publish the .md and .hbs changes in real-time (otherwise there will be a menu item pointing to a .md file that does not exist)
[x] File does not use CRLF, but uses plain LF (hint: use cat -ve <filename> | grep '^M' | wc -l and expect 0 as a result)
[x] Has passed bart check
[x] Has been manually tested by running in Spin/Bartholomew (hint: use PREVIEW_MODE=1 and run npm run styles to update styling)
[x] Headings are using Title Case
[x] Code blocks have the programming language set to properly highlight syntax and the proper copy directive
[x] Have tested with npm run test and resolved all errors
[x] Relates to an existing (potentially outdated) blog article? If so please add URL in blog to point to this content.

This seems to be the post that I wrote. I had originally meant that as a blog post and not as documentation. I'm more than happy to let this live as documentation (since that's generally longer lived anyway), but then I'm not quite sure if we want to also have a blog post, and if so what that blog post should say.


Feature:  collection/partion filter

Describe the feature:
A quick filter that user can find his collection/partition easily.

Is that ok to add global search to the overall pages?

@congtan0224 I think we just want to add a search/filter bar in the collection/partition table.

Is [auto-fill] needed?

plan B, when type in character, the item in the table will be filtered and shown directly

We can discuss this issue in tomorrow's meeting.

If needed, design's here.


Q: overlay box

Hey all, is it possible to draw a box using x/y coordinates that would overwrite whatever is under it, say another box?
Like having spawing bar over foo:
|-----|
|     |
| foo |
|     |
|-----|

|-----|
|     |
| foo |
|   |-----|
|---|     |
    | bar |
    |     |
    |-----|

Thanks!

Hi again! This is a feature currently in development. There's no time frame yet, but it'll be implemented in Lip Gloss (see https://github.com/charmbracelet/lipgloss/issues/65) with additional support in Bubble Tea (https://github.com/charmbracelet/bubbletea/issues/79). We'll keep those issue updated with progress. Lip Gloss will likely come first, with Bubble Tea following shortly thereafter.

can you please post the updates (if any) on this ? its more than 2 years now.


Could not find root URL that matches running application URL" plugin=volkovlabs-echarts-panel appUrl=http://xxxxxx:3000/grafana/ rootUrls="unsupported value type"

Skipping loading plugin due to problem with signature
Hi, When i was trying to install this plugin. i found out below error log from my /var/log/grafana/grafana.log, BTW: I already configureate this allow_loading_unsigned_plugins = volkovlabs-echarts-panel in my grafana.ini
logger=plugin.manager t=2022-07-04T10:59:28.958393913+08:00 level=info msg="Plugin registered" pluginId=input
logger=plugin.loader t=2022-07-04T10:59:29.082900685+08:00 level=warn msg="Could not find root URL that matches running application URL" plugin=volkovlabs-echarts-panel appUrl=http://localhost:3000/grafana/ rootUrls="unsupported value type"
logger=plugin.loader t=2022-07-04T10:59:29.082991956+08:00 level=warn msg="Skipping loading plugin due to problem with signature" pluginID=volkovlabs-echarts-panel status=invalid```
and set conf grafana.ini
server:
root_url = %(protocol)s://%(domain)s:%(http_port)s/grafana
serve_from_sub_path: true

https://github.com/VolkovLabs/volkovlabs-echarts-panel/issues/17#issuecomment-1173998642
I have solved this problem.
I am closing the issue for now.

@stdnt-xiao Thank you for use the plugin. You just need to remove the MANIFEST.txt file, and you should be good.
Please let us know if there is anything else.


fix theme name so hugo builds

Following your guide to copy exampleSite config.toml leads to this error
Error: module "manis" not found; either add it as a Hugo Module or store it in "/Users/tobiasmcvey/projects/blogmanis/themes".: module does not exist

Just need to fix the theme name in the exampleSite config.toml file
from
theme="manis"

to
theme = "manis-hugo-theme"

and Hugo builds :)
Great looking theme btw

Thank you, this is because I expect people to rename the theme folder to manis. Guess I'll merge this PR and change the README.


add text condition for gen music

The music cannot be controlled through text. It's better with text constraint like text2img, I think that.

it's possible by using such data to train / finetune the model


remove ensyme from a few packages

Description
Fixes (issue #)

Type of change

[ ]  Patch: Bug/ Documentation fix (non-breaking change which fixes an issue or adds documentation)
[ ]  Minor: New feature (non-breaking change which adds functionality)
[ ]  Major: Breaking change (fix or feature that would cause existing functionality to not work as expected)

Checklist

[ ] I have added a changelog entry, prefixed by the type of change noted above

We noticed that this PR either modifies or introduces usage of the dangerouslySetInnerHTML attribute, which can cause cross-site scripting (XSS) vulnerabilities. Our team will take a look soon, but for now we recommend reviewing your code to ensure that this is what you intended to use and that there is not a safe alternative available. Docs are available here.


Feature/22 simplify api

Describe your changes
Changed API to bit more flexible layout
Issue ticket number and link
Closes #22
Checklist before requesting a review

[x] Does mix test work?

All good testing on hardware


Setting tags-from-host=true overrides other specified tags

As far as I can tell this has only recently stopped working. Previously I believe it was possible to merge both tags-from-host and tags.
Below is the configuration file I'm using:
# The token from your Buildkite "Agents" page
token="<redacted>"

# The name of the agent
name="%hostname-%n"

# Tags for the agent (default is "queue=default")
tags="queue=gjg-default,foo=bar"

# Include the host's meta-data as tags (hostname, machine-id, and os)
tags-from-host=true

# Path to where the builds will run from
build-path="/var/lib/buildkite-agent/builds"

# Directory where the hook scripts are found
hooks-path="/etc/buildkite-agent/hooks"

# When plugins are installed they will be saved to this path
plugins-path="/etc/buildkite-agent/plugins"

With this configuration only the host tags are attached to the agent:

However, if set tags-from-host=false my specific tags are attached to the agent:

Is this intended behaviour? Or should both host and specified tags be attached the agent?

We're investigating, looks like a regression in 3.10.2.

We have a fix in https://github.com/buildkite/agent/issues/967, will get it released shortly.

Thanks @lox for the prompt response 👍

No problems, apologies for the breakage in a point release!

Don't be so hard on yourself, we've all been there :)

Fixed in v3.10.3


Redis Data Connector

Problem

As a user I would like to be able to have schema driven and type safe data storage using a redis API. In particular a use case could be to use Upstash which provides a durable, serverless data storage using the standard redis API.
Suggested solution

Provide a Redis connector in addition to MySQL, PostgreSQL etc..
Alternatives

None afaict.
Additional context

I want to be able to use Prisma with Postre and Redis at the same time. This would be amazing.

As @blazestudios23 said, using Prisma with Postre and Redis would be awesome. Prisma ecosystem can make using Redis much more productive and easier.

This will be super-cool.

RedisGraph specifically would be great!

Definitely would want this.

Yes this would make a lot of sense. Love Prisma so far.

Would be amazing to be able to use Prisma + Redis Cloud!

Any updates or plans to implement Redis? I've been using RedisOM as my primary database and I feel a Prisma implementation would be superior

Bumping to see progress on this to build out Redis + Postgres w/ Prisma. Will help if the project has been started!

I would also want to help as a contribution from Upstash

Hi there,
As part of our effort to clean up our GitHub repo, we’re closing this issue to help focus on features and improvements that align with our focus areas and those of our community.
If this is issue is still important to you, feel free to reopen the issue and get like-minded users to upvote as we will prioritize fixing issues based on community interest. If you do reopen the issue, please ensure that there’s a clear method for us to reproduce it.
For more insight into our priorities and how we’re thinking about the future of the Prisma ORM, please see our recent blog post: https://www.prisma.io/blog/prisma-orm-manifesto.
Thank you for your understanding and support!


[RFE] Allow listing the POD from a specific namespace

in addition of the existent parameter, it would be great to allow a filter based on the namespace, providing the list of the PODs running within this namespace.

Implemented in 0.4.0


URL components are not urlencoded, resulting in API failures for objects with certain names

I have a cache condition with a name containing a character which needs to be urlencoded. (ex: a text/html condition). When I execute the following code which simply lists and tries to delete conditions which are found, it will fail:
        existingCacheSettings, err := client.ListCacheSettings(&fastly.ListCacheSettingsInput{Service: "abcd", Version: 10})
        for _, setting := range existingCacheSettings {
                err := client.DeleteCacheSetting(&fastly.DeleteCacheSettingInput{Service: "abcd", Name: setting.Name, Version: 10})
                if err != nil {
                        return err
                }
        }

The reason it is failing is because it ends up calling the following URL:
/service/abcd/version/10/condition/text/html

(note the unescaped forward-slash)
Any parameters which go into forming an API call URL should be urlescaped to prevent issues such as this. These object names are perfectly valid from Fastly's POV, but will cause go-fastly to malfunction.
I tried to address this in go-fastly by wrapping all URL components which could contain these characters in an escape method from net/url. Unfortunately, name components in the Fastly API may contain not only forward slashes but also whitespace, and net/url has no method to deal with both possible cases. Fixing this in go-fastly may require that we do a bit of a hacky strings.Replace().

Bit of a stretch, but I've submitted a case to net/url to see if this type of escaping functionality can be supported: https://github.com/golang/go/issues/16207

For now I think the best option avail is to write a small function which calls url.Parse() on URL components, and also encodes the forward-slashes. Started work on it this evening. I'll plan on sending a PR tomorrow.

Looks like go 1.8 might fix this: https://github.com/golang/go/commit/7e2bf952a905f16a17099970392ea17545cdd193

Did this ever got fixed (in go 1.8)?
I run into similar problem in Terraform 0.9.4 with conditions that included / in names.


I have some issues when I use KubeVirt Snapshot Restore API

I can successfully create a vm, but I can only capture vm's configuration (such as its disk size).  Currently, I only can restore its configuration , but I can't restore its files by the snapshot.
when I use kubectl get vm hello -o yaml, the output is:
apiVersion: kubevirt.io/v1
kind: VirtualMachine
metadata:
  annotations:
    description: ""
    kubevirt.io/latest-observed-api-version: v1
    kubevirt.io/storage-observed-api-version: v1alpha3
    restore.kubevirt.io/lastRestoreUID: restore-hello-8472e5ae-1760-44e8-a2f1-56630d85ebf9
    tkestack.io/image-display-name: win16server
  creationTimestamp: "2022-07-05T00:12:52Z"
  generation: 5
  labels:
    kubevirt.io/domain: hello
  name: hello
  namespace: default
  resourceVersion: "29431648"
  uid: e6b91af2-3700-4677-b6cc-1ac60871e681
spec:
  dataVolumeTemplates:
  - metadata:
      creationTimestamp: null
      name: rootfs.hello
    spec:
      pvc:
        accessModes:
        - ReadWriteMany
        resources:
          requests:
            storage: 50Gi
        storageClassName: csi-cephfs-sc
        volumeMode: Filesystem
      source:
        pvc:
          name: win16img
          namespace: kube-public
  - metadata:
      creationTimestamp: null
      name: datavolume1.hello
    spec:
      pvc:
        accessModes:
        - ReadWriteMany
        resources:
          requests:
            storage: 50Gi
        storageClassName: csi-cephfs-sc
        volumeMode: Filesystem
      source:
        blank: {}
  running: false
  template:
    metadata:
      annotations:
        tkestack.io/image-display-name: win16server
      creationTimestamp: null
      labels:
        kubevirt.io/domain: hello
    spec:
      domain:
        cpu:
          cores: 1
        devices:
          disks:
          - bootOrder: 1
            disk:
              bus: virtio
            name: rootfs
          - bootOrder: 2
            disk:
              bus: virtio
            name: datavolume1
          inputs:
          - bus: usb
            name: tablet
            type: tablet
          interfaces:
          - bridge: {}
            model: virtio
            name: default
        machine:
          type: q35
        resources:
          requests:
            memory: 1G
      networks:
      - name: default
        pod: {}
      volumes:
      - dataVolume:
          name: rootfs.hello
        name: rootfs
      - dataVolume:
          name: datavolume1.hello
        name: datavolume1
status:
  conditions:
  - lastProbeTime: "2022-07-05T00:23:53Z"
    lastTransitionTime: "2022-07-05T00:23:53Z"
    message: VMI does not exist
    reason: VMINotExists
    status: "False"
    type: Ready
  - lastProbeTime: null
    lastTransitionTime: null
    message: cannot migrate VMI which does not use masquerade to connect to the pod
      network
    reason: InterfaceNotLiveMigratable
    status: "False"
    type: LiveMigratable
  printableStatus: Stopped
  volumeSnapshotStatuses:
  - enabled: false
    name: rootfs
    reason: 'No VolumeSnapshotClass: Volume snapshots are not configured for this
      StorageClass [csi-cephfs-sc] [rootfs]'
  - enabled: false
    name: datavolume1
    reason: 'No VolumeSnapshotClass: Volume snapshots are not configured for this
      StorageClass [csi-cephfs-sc] [datavolume1]'

In the end on the above, it suggests me that No VolumeSnapshotClass: Volume snapshots are not configured for this       StorageClass [csi-cephfs-sc] [rootfs].
So How to configure ...,  Can someone help me? Please
At last, when I use kubectl get volumesnapshotclass, the output is
NAME                         DRIVER                DELETIONPOLICY   AGE
csi-cephfsplugin-snapclass   cephfs.csi.ceph.com   Delete           4d22h

when I use kubectl get sc, the output is
NAME            PROVISIONER           RECLAIMPOLICY   VOLUMEBINDINGMODE   ALLOWVOLUMEEXPANSION   AGE
csi-cephfs-sc   cephfs.csi.ceph.com   Delete          Immediate           true                   39d

I am sure the provisioner property of  StorageClass matches the driver property of the VolumeSnapshotClass.

Hi @muleimulei
KubeVirt controller looks for VolumeSnapshotClass to be present in the v1 version,  can you verify if the volume snapshot class is being served from v1 version?
https://github.com/kubevirt/user-guide/pull/552

Hi @viveksinghggits
[root@node-2 mulei_dir]# kubectl get volumesnapshotclass -o yaml
apiVersion: v1
items:
- apiVersion: snapshot.storage.k8s.io/v1
  deletionPolicy: Delete
  driver: cephfs.csi.ceph.com
  kind: VolumeSnapshotClass
  metadata:
    annotations:
      kubectl.kubernetes.io/last-applied-configuration: |
        {"apiVersion":"snapshot.storage.k8s.io/v1","deletionPolicy":"Delete","driver":"cephfs.csi.ceph.com","kind":"VolumeSnapshotClass","metadata":{"annotations":{},"name":"csi-cephfsplugin-snapclass"},"parameters":{"clusterID":"05d7dd64-c075-4c86-9ed5-2773d1a56573","csi.storage.k8s.io/snapshotter-secret-name":"csi-cephfs-secret","csi.storage.k8s.io/snapshotter-secret-namespace":"tke"}}
    creationTimestamp: "2022-07-07T00:42:56Z"
    generation: 1
    name: csi-cephfsplugin-snapclass
    resourceVersion: "31008746"
    uid: c5a25f0c-6b9d-4953-ae4a-a15826f5b917
  parameters:
    clusterID: 05d7dd64-c075-4c86-9ed5-2773d1a56573
    csi.storage.k8s.io/snapshotter-secret-name: csi-cephfs-secret
    csi.storage.k8s.io/snapshotter-secret-namespace: tke
kind: List
metadata:
  resourceVersion: ""
  selfLink: ""

it's v1 version. Will it be related to the namespace? My KubeVirt controller is in vm-manager namespace , but my  volume snapshot controller is in kube-system namespace . I have no idea. Thanks for your reply.

I don't think snapshot-contrller being present is another namespace is going to be a problem.
I recommend you checking virt-controller's logs.

Create vm is fail,  Error info ....
Warning  FailedPvcNotFound  7m (x20 over 17m)  virtualmachine-controller  failed to render launch manifest: didn't find PVC 74v4-snap-os

Snap create is ok :

kubectl  get pvc -n csi-ceph-rbd
NAME               STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS   AGE
74v4               Bound    pvc-74a41d1b-d1a8-4d6c-b529-bef72243a3ca   38Gi       RWO            csi-rbd-sc     48m
74v4-snap-data     Bound    pvc-6c18b9bc-f545-49f4-88cc-8ceb95d0b904   100Gi      RWO            csi-rbd-sc     23m
74v4-snap-os       Bound    pvc-3f6fa67f-5449-435a-8e87-e8a3216b3efc   40Gi       RWO            csi-rbd-sc     24m

vm.yaml
[root@k8s-master-thallo-72-211-lf3 vv1]# cat 74v4-snap.yaml
apiVersion: kubevirt.io/v1
kind: VirtualMachine
metadata:
name: 74v4-snap
namespace: k8s-vmi
spec:
running: true
template:
metadata:
labels:
kubevirt.io/vm: 74v4-snap
spec:
terminationGracePeriodSeconds: 30
domain:
resources:
requests:
memory: 4096M
devices:
disks:
- disk:
bus: virtio
name: 74v4-snap-os
- disk:
bus: virtio
name: 74v4-snap-data
- disk:
bus: virtio
name: cloudinitdisk
interfaces:
- bridge: {}
name: default
networks:
- name: default
pod: {}
volumes:
- name: 74v4-snap-os
persistentVolumeClaim:
claimName: 74v4-snap-os
- name: 74v4-snap-data
persistentVolumeClaim:
claimName: 74v4-snap-data
- name: cloudinitdisk
cloudInitNoCloud:
userData: |-
runcmd:
- [ systemctl, restart, --no-block, salt-minion ]


Add notebook support

Adds Jupyter notebooks support for for better visibility. Now cells are more readable and current cell is outlined.

Dark Soft - before
Dark Soft - after

Dark Medium - before
Dark Medium - after

Dark Hard - before
Dark Hard - after

Light Soft - before
Light Soft - after

Light Medium - before
Light Medium - after

Light Hard - before
Light Hard - after

@piotrwieckiewicz Thank you so much, it looks great
Would you like to add yourself into the contributor list in package.json & README.md?

@jdinhify Done

:tada: This PR is included in version 1.8.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


[BUG] Getting 'TypeError: b is not a function' for production build

Describe the bug
My tooltip is working just fine when running locally with my NextJS dev server. However my production build throws the following error:

Uncaught (in promise) TypeError: b is not a function
at _ (747-e70f1fec8bbda825.js:1:2290)
at Object.isRTL (747-e70f1fec8bbda825.js:1:7593)
at 747-e70f1fec8bbda825.js:1:7765
at $ (747-e70f1fec8bbda825.js:1:9305)
at et (747-e70f1fec8bbda825.js:12:4104)
at 747-e70f1fec8bbda825.js:12:8615
at uU (framework-3b5a00d5d7e8d93b.js:9:84130)
at oV (framework-3b5a00d5d7e8d93b.js:9:113201)
at o (framework-3b5a00d5d7e8d93b.js:9:107748)
at x (framework-3b5a00d5d7e8d93b.js:33:1374)

When I remove the Tooltip element the error goes away. I attempted to get more information by turning off minification in my NextJS build, and that actually caused the error to go away entirely.
Version of Package
v5.7.3 (also tested with 5.7.2 and 5.6.0)
To Reproduce
Run a production build with minification (not sure if there is something specific to NextJS)
Expected behavior
No Errors, and the tooltip renders on the browser

@gabrieljablonski here is a repo with the issue. it works if you use npm run dev, but if you do npm run build followed by npm run start, you'll see the error I'm talking about.
https://github.com/thomasbottonari/react-tooltip-error

Thanks for taking the time.
I'm honestly not sure what's causing this, but my first guess is some issue with the minifier.
This is the code formatted using the devtools. Line 517 is the problem, in which w is being called, but it not a function.

But that shouldn't be the case, since you can see right above the declaration for b() is the declaration for w().

For reference, b() is getComputedStyle() from floating-ui and w() is (or should be) getWindow().

If you inspect w:

I haven't fully followed the call stack to make sure, but I'm quite sure the w object is being overwritten in line 1445:

I'm quite sure this isn't a problem directly with react-tooltip. It might be with floating-ui, but I'm leaning towards being a problem with the default minifier for Next.js.
If you're willing to investigate further, what I'd recommend you do next is try to use a different minifier engine (not sure how you'd do that, you can probably set it up somehow in the Next.js config).
Another thing you could try is changing the sample project you built to call computePosition() directly from floating-ui and see if the problem still happens (I'm guessing it will), and then you can submit a issue there.

Just a heads up, your example is using Next.js 13, we didn't test Next.js 13 with our library. I'm a fan of the Next.js project, but Next 13 still has a lot of bugs and we should wait more time for the next releases (this is only my opinion).
The library is working fine with Next.js 12, also, you always can import React-Tooltip minified or not, the default one is minified but we export non-minified too as you can see here: https://github.com/ReactTooltip/react-tooltip#standalone

It looks like Next.js switched their default minifier as of v13 (https://nextjs.org/docs/advanced-features/compiler#minification). If you set swcMinify: false, it will use Terser instead of SWC. I confirmed that this works for me and the performance hit during build time isn't a concern for me.

Good to know my diagnosis wasn't far off haha
Thanks for reporting this, other people will probably run into it as well.

I was able to resolve this issue by importing import { Tooltip as ReactTooltip } from 'node_modules/react-tooltip/dist/react-tooltip.umd.js' directly. If you don't want to change swcMinify to false.

I was able to resolve this issue by importing import { Tooltip as ReactTooltip } from 'node_modules/react-tooltip/dist/react-tooltip.umd.js' directly. If you don't want to change swcMinify to false.

In case it helps others, I was able to implement a import redirect in next.config.js so that I don't accidentally import the wrong one in the future. Here is the code to do that.
webpack: (config) => {
    config.resolve.alias = {
      ...config.resolve.alias,
      'react-tooltip$': path.resolve(
        __dirname,
        'node_modules/react-tooltip/dist/react-tooltip.umd.js'
      ),
    };
    return config;
  }

With this in place you can just import { Tooltip } from 'react-tooltip'; as you normally would.

Upgrading to Next.js >= 13.3.0 also fixes this. For more info see #1001


Cannot get links

Whenever I open an song to get links. I get this error @akashpopat
This issue is for all the songs

@akashpopat plz fix this issue. I havent received any response if it's problem with my device


Avoid adding Host header in reverse mode for HTTP2 streams

In "Reverse Proxy" mode, the proxy was adding "Host" headers to all requests sent out, even for ones on HTTP/2 connections.
The spec says this is something senders should not do:

Clients that generate HTTP/2 requests directly SHOULD use the ":authority" pseudo-header field instead of the Host header field.  An intermediary that converts an HTTP/2 request to HTTP/1.1 MUST create a Host header field if one is not present in a request by copying the value of the ":authority" pseudo-header field.

Apparently, various HTTP/2 servers were not taking it well, and responded to such requests with RST_STREAMs indicating PROTOCOL_ERROR.
This PR changes that behavior.

Hey @yoavweiss!
So, my reading of RFC 7540 leads me to want to assume the following behaviours:

If translating H2 -> H2, mitmproxy should leave the headers exactly as the client generated them. If the client put :authority and Host, mitmproxy should leave those there.
If translating H1 -> H2, the :authority header MUST be omitted, per Section <IP_ADDRESS>, with the Host header left in place. mitmproxy is not a client in this context, it's an intermediary, so if it is doing translation then it is bound by that requirement.
If translating H2 -> H1, obviously the :authority header needs to be translated into a Host header.

So I'm not sure about the decision here which avoids adding the Host header. I think the Host header should almost never be removed, per my reading of RFC 7540.

Thanks @Lukasa for sharing your opinion here!
About 3., the RFC states:

An intermediary that converts an HTTP/2 request to HTTP/1.1 MUST
create a Host header field if one is not present in a request by
copying the value of the ":authority" pseudo-header field.

One could argue now that, "copying" implies that the :authority header remains. Or do you think it should be translated, i.e., replaced by a host header?
I think we have a special case, in that we are trying to manipulate an h2-request and send it off to a different host (reverse proxy mode). The question here is now, is it valid to have :authority AND host headers, and should h2-servers accept that.
Apparently @yoavweiss found himself dealing with a server that simply fails and sends PROTOCOL_ERROR if a request with both headers is sent (even if they contain the same value).

Thanks for chiming in @Lukasa! :)
In reverse proxy mode (and only in reverse proxy mode), we change the value of the host header to whatever upstream server the user has specified. This is indeed not standard-conformant, but we had a lot of users complaining that e.g. the following would not work:
$ mitmdump -R http://example.com/
$ curl localhost:8080

Without rewriting the host header, that'd fail with a 404 because we forwarded the original Host: localhost the client has sent. We should add a --keep-host-header flag to enforce standard-conformant behaviour, but since we added this auto-rewrite this topic basically did not come up anymore.
The issue at hand is that the current rewriting is hardcoded to the "Host" header, not taking HTTP/2 into account. This is more or less a general issue we still have, see https://github.com/mitmproxy/mitmproxy/pull/1791.
I believe the nicest way to solve that is adding a request.host_header property that routes to whatever is the right header. I'll open a separate issue for that in a second to discuss it a bit further.

One could argue now that, "copying" implies that the :authority header remains. Or do you think it should be translated, i.e., replaced by a host header?

The pseudo-header fields must be removed in a HTTP/1.1 request. That means that copying means "move its data to the Host header, and then delete the header".

The question here is now, is it valid to have :authority AND host headers, and should h2-servers accept that.

Yes, it is. Specifically, RFC 7540 says that emitting only :authority is SHOULD, not MUST, and so conformant h2 servers should accept it so long as both fields are the same.
I agree with @mhils however: the caveat is that both fields must be the same. In fact, if you had hyper-h2 header validation on you'd find that sending mismatched Host and :authority headers is forbidden. :wink:

Thanks! I'm not sure about the precise circumstances of the original issue, but from what @yoavweiss reported, :authority and host were both present, and contained the same value (i.e. matched). And yet the server still sent an error.
Any way, the best way forward is to only change those headers that are already present and not add any more in mitmproxy, unless we are translating between H1 and H2 - which we are not doing anyway at this time.

So, as with all things: just because the server SHOULD tolerate this doesn't mean it will. ;)

FYI, #2040 should also fix this. :smiley:

FYI, #2040 should also fix this. 😃

Cool, closing this one.

Thanks! I'm not sure about the precise circumstances of the original issue, but from what @yoavweiss reported, :authority and host were both present, and contained the same value (i.e. matched). And yet the server still sent an error.

Just to emphasize, I hit this issue with 3 different server implementations (2 of them returned a PROTOCOL_ERROR after the request, and one simply returned a 400 response. I failed to find an H2 sites served by a server that accepted these requests (even though there may be ones).

Yes, very good to get this fixed. Thanks again for the initial PR! :smiley:

Which servers were doing this? They're broken.

I found 3 servers that were doing that: nginx, Akamai's H2 server and Fastly's H2 server (probably H2O).
But, I think I misdiagnosed and the reason for the PROTOCOL_ERROR/400 wasn't the presence of Host but the fact that it contained uppercased letters, which is spec compliant behavior AFAICT.
Just as in HTTP/1.x, header field names are strings of ASCII
   characters that are compared in a case-insensitive fashion.  However,
   header field names MUST be converted to lowercase prior to their
   encoding in HTTP/2.  A request or response containing uppercase
   header field names MUST be treated as malformed (Section <IP_ADDRESS>).

Heh, yes, mitmproxy should probably be fixing that up a bit too. ;)

Aha! That makes a lot more sense.

But, I think I misdiagnosed and the reason for the PROTOCOL_ERROR/400 wasn't the presence of Host but the fact that it contained uppercased letters, which is spec compliant behavior AFAICT.

Ugh - this was caused by the same HTTP/2 unaware host header rewriting, sorry. This specific case has been fixed by #2040 already, @Kriechi enabled the uppercase checks for all headers in #2055 now.


Merge Projectiles with new Map Service

Description
Task: Merge Projectiles with new Map GameAreaService
Feature: Projectile Feature and Map Feature
The new feature of having the GameAreaService allows projectiles to spawn projectile entities from within projectile classes. Merging this in another branch earlier than merge conflicts with main to allow for projectile development to continue early.
Dependencies

[x] Projectile Team

Milestones
List of steps that need to be completed for this task.

[x] Merge projectile branch to be up to date with changes on Maps Branch (Sep. 5)
[x] Refactor code to work with the GameAreaService
[x] Spawn in projectiles at proper system areas when shooting
[x] Merge into team-6-maps

Completion Deadline:
September 6

Created a diagram of MapGenerator output to actual map outlay to deduce area error was occuring


Push address does not work

I tried pushing a address with the example code in the readme file
address = " 25 E 85th St, 10028 New York, NY"
push = pb.push_address("home", address)

This results in this error:
pushbullet.errors.PushError: {"error":{"code":"invalid_param","type":"invalid_request","message":"The param 'type' has an invalid value.","param":"type","cat":"\u003e:3"},"error_code":"invalid_param"}

the send note does work! So I'm sure the settings are right.

Hi @Timvdv,
I ran a unit test with your address and works correctly. Tomorrow I will test it via real Pushbullet service.

Well, "address" and "list" types was removed in api v15.
See change January 28, 2015: https://docs.pushbullet.com/#changelog
Thanks for your report.

@kovacsbalu Do you know if there is a replacement for showing an address? I was hoping for some kind of map view within Pushbullet, but I guess I'd just have to push the address as a note :(

I really don't know. :(
I will create a PR and show address and list type as deprecated.


Show changes in submodules in PR

Feature Description
It would be very useful to be able to see changes made in submodules when reviewing a PR, instead of just seeing the changed submodule commit hash.
This is supported by git using the git diff --submodule=diff main option, which I'm guessing means that the changes needed on the Gitea end would be relatively small: submodule contents would need to be fetched and the diff command tweaked.
I imagine this would be an option to enable (per repo, per org or globally?).
Example (cleaned for readability) output from git diff as it used by Gitea now:
README.md:
+
+And now we've added a sub repo, to see how that works.

sub-repo:
-Subproject commit 773e95df076c02e982bea7eb745866e92e0cfcfb
+Subproject commit 4326ed282c7f5bd49fd4a29c1ac0f414d25d71b9

Example output using git diff --submodule=diff:
README.md:
+
+And now we've added a sub repo, to see how that works.

sub-repo/README.md:
+# Sub repo
+
+Test av hur Gitea hanterar ändringar i sub-repon.

This would make it a lot easier to review all the changes for a PR of the parent repo in a single view, instead of manually having to navigate separate PRs for each submodule. Especially in projects using many submodules, this saves a lot of time and mental effort.
You would still need to create PRs for merging the changes for each submodule into their respective main branches, but at least the review can be performed efficiently for the overall work before performing those PRs.
Screenshots
No response

I don't believe we would need to fetch submodule content and change the command here. We can just coalesce the diff output between repositories directly.
If there is a submodule, issue a diff to child repository -- it either is on the server, which makes this trivial, or it's not, so we can't do submodule diff then.. We already have the two relevant commit ids from the parent repository. Then replace the paths and append the diffs.
Thing to keep in mind is that these submodules could be recursive and one could even craft an infinite recursion.
I think that having UI option in the diff/commit view to either include the submodule diff or not would be best here.

Yes, your approach sounds like a good idea.
However, we then need the following adjustments:

there is either a timeout, a recursion detection mechanism, or both. The timeout would be the dirty solution. We probably need both.
files that changed in a submodule must be visually distinct from all other files to make it immediately clear that you didn't change them yourself
the same detection would also be needed when viewing any commit, or any subrange of a PR

Well, you did change them yourself, through updating the commit id for the submodule. But I agree it would be a good idea to have this visually distinct.
If submodule is detected in the diff, we can add a diff submodule menu. For example,

no submodule expansion
1-level submodule expansion
recursive expansion

Similar to the one we have for whitespace, etc.


Output format

Need to update our TA2 output to better conform to the evaluation spec. Currently, we are storing our primitive pickle files in directories under executables. These directories should be moved to supporting_files directory. According to the evaluation spec, there should only be files in executables.  Each file in executables specifies a specific pipeline generated by our system. The evaluation system will give this file to our TA2 system as argument.
The proposal is to have our pipeline spec under executables to be a json file. This json file simply specifies the pipeline id.
{
    "fitted_pipeline_id" : "2a61ba42-e08b-47cc-a0bb-40cec7c1f3a7"
}

With this executable/<pipeline_id>.json, our ta2 system can walk up the supporting_files\<pipeline_id> directory to load the pickle files, and look up the pipeline definition in pipelines\<pipeline_id>.json
Here is the directory hierarchy from the evaluation spec:
./pipelines
    <pipelineId_1>.json
./executables
    <pipelineId_1>.yyy
./supporting_files
    ./<pipelineId_1>
        file1.yyy
        file2.yyy
        ./folder1
./predictions
    ./<pipelineId_1>
        predictions.csv
metadata.yml

@kyao Finished and got merged into branch 'template-2018-june' with commit 86e890fbd1815c76e2e222c23be8ac0b72c34ccd, please check

@RqS Looks good to me


Page editor junkifies unicode characters

For example if attempting to paste █ into the HTML, it will be converted to a ? when the server saves it. Unsure if it's the editor or server's fault atm.

I think this is related to the server more than the editor because it does work for me:
https://github.com/isislab/CTFd/issues/47

Tried this on demo.ctfd.io.
On ctfd.io I deploy with an nginx front end that proxies to gunicorn.

What's the reference locale?
:~/CTFd/CTFd$ locale
LANG=en_US.UTF-8
LANGUAGE=
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=

As we discussed on IRC, this is likely due to models.py using the TEXT type instead of the UNICODE type.

So, when setting CTFd up with MySQL you probably want to do:
alter database ctfd character set utf8 collate utf8_unicode_ci;
use ctfd;
alter table challenges convert to character set utf8 collate utf8_unicode_ci;
alter table pages convert to character set utf8 collate utf8_unicode_ci;
alter table config convert to character set utf8 collate utf8_unicode_ci;
alter table files convert to character set utf8 collate utf8_unicode_ci;
alter table solves convert to character set utf8 collate utf8_unicode_ci;
alter table tags convert to character set utf8 collate utf8_unicode_ci;
alter table teams convert to character set utf8 collate utf8_unicode_ci;
alter table tracking convert to character set utf8 collate utf8_unicode_ci;

and in /etc/mysql/my.cnf ensure this exists...
[mysqld]
default-character-set=utf8
default-collation=utf8_general_ci
character-set-server=utf8
collation-server=utf8_general_ci
init-connect='SET NAMES utf8'


[BUG] Probe: Reduce load on the host apiserver during namespace/secret update

Describe the bug:
The dependency watchdog probe watches/reconciles the namespaces and secrets to re-configure/setup probes for the individual shoot namespaces to be probed.
Such reconciliation is not optimal right now as it treats each update to the namespace/secret as potentially a change to the kubeconfig secrets and proceeds to explicitly retrieve the secrets from the host apiserver and re-configure the probes.
This is suboptimal and can cause high load on the host apiserver and might end up throttling (see the log below) the probe process itself leading to many of the namespaces' shoot apiserver not probed for substantial period of time (> 2m) which could be enough time for the individual kube-controller-managers to act (potentially erroneously due to apiserver loadbalancer issues) on unresponsive nodes and mark them as NotReady.
Expected behaviour:
Individual probes for the different namespaces' shoot apiservers should be up as long as possible and should be reconfigured only if the kubeconfig secrets actually changed (with the content of the kubeconfig changing).
The down time for the individual probes should be as little as possible with secrets being loaded from the local informer cache rather than using a get call on the host apiserver (thus also reducing the load on the host apiserver).
How To Reproduce (as minimally and precisely as possible):
Logs:
Throttling request took 196.193411ms, request: GET:https://...:443/api/v1/namespaces/.../secrets/dependency-watchdog-external-probe

Screenshots (if applicable):
Anything else we need to know?:

Thanks for opening @danielfoehrKn and @amshuman-kr in regards to the misbehaviour noticed last week.
Another remark: Since we have very large secrets and you mentioned all data would be pulled, this could be responsible not only for significant load, but also for significant network traffic and be another major cost driver.
/critical
Raising priority as this problem has caused actual issues due to the KCM marking nodes as NotReady and the consequences of that.

Maybe another question from my side: why is there an internal and also external probe using the LoadBalancer?  Just want to understand the use-case.
To my understanding that adds quite some external network traffic (have not measured it though).
@vlerenc isn't the network traffic only cluster-internal for pulling the secrets?

Maybe another question from my side: why is there an internal and also external probe using the LoadBalancer? Just want to understand the use-case.
To my understanding that adds quite some external network traffic (have not measured it though).

The external probe probes the shoot apiserver via the loadbalancer (like the shoot node's kubelet does) and the internal probe probes the shoot apiserver via the service cluster IP. This is to be sure to scale down KCM only if the issue is due to the loadbalancer and not something in the apiserver pods themselves.

@vlerenc isn't the network traffic only cluster-internal for pulling the secrets?

The secrets are pulled from the seed apiserver which sits in the soil cluster. Hence, it will be external network traffic.

Raising priority as this problem has caused actual issues due to the KCM marking nodes as NotReady and the consequences of that.

Agreed in the priority. I have started work on this already.

Yes @amshuman-kr and we have seen that e.g. the gardener resource manager and similar reconcilers are responsible for some fraction of the exorbitant network traffic. That may be another one of interest that we may want to get down.

@vlerenc Just to be clear, the get calls happen only whenever the shoot namespaces and secrets in them are updated. So, it doesn't happen for each probe by the watchdog. So, traffic reduction may not be substantial. Or might be substantial only during seed updates. But this is a critical fix anyway to make sure the probes are minimally disrupted during seed updates.

Fixed in the release v0.4.1.


@auth warning in documentation to avoid limitations in Cognito Groups

Is your feature request related to a problem? Please describe.
In the documentation the recommended approach for for dynamic group authorization is to utilize Cognito Groups. However, there are service limits that exist on Cognito Groups that limit the usefulness of the solution - maximum of 25 groups per user and maximum of 500 groups per account.
(https://aws-amplify.github.io/docs/cli-toolchain/graphql#dynamic-group-authorization)
Describe the solution you'd like
Its too late for me, but I think you should include warnings in the documentation highlighting the limitation on Cognito Groups and provide instructions on how to implement Group authorization where the Groups can be defined in the database and how resolvers should be updated to deal with groups defined in DynamoDB rather than in Cognito.
Describe alternatives you've considered
I figure I'm going to have to create a type groups { } that is linked to a type users { } in DynamoDB and update resolvers to check the groups table for the current user. However, I suspect I'm going to have to generate a pipeline resolver to achieve this and this is still open on how to do that within Amplify.
Additional context
The approach of using Cognito Groups as the recommended approach in the documentation should come with ample warning in the documentation on the limitations. And documenting a recommended approach to do this outside Cognito Groups to avoid those limitations.

I figure I'm going to have to create a type groups { } that is linked to a type users { } in DynamoDB and update resolvers to check the groups table for the current user. However, I suspect I'm going to have to generate a pipeline resolver to achieve this and this is still open on how to do that within Amplify.

Transformer supports changing groupClaim field to any field in the JWT token, and you could use Pre Token Generation Lambda Trigger, to update your token with groups that a user belongs to. This is documented here


Is it possible to send custom headers?

we're trying to send custom headers for NTML authentification purposes.  I've tried  this
const client = axios.create({ //all axios can be used, shown in axios documentation   baseURL: 'http://<IP_ADDRESS>:8080',   options: {     responseType: 'json',     SamAccount: 'username'   } });
and
const client = axios.create({ //all axios can be used, shown in axios documentation   baseURL: 'http://<IP_ADDRESS>:8080',   options: {     responseType: 'json',     headers: { 'SamAccount': 'username' };   } });
but we're not seeing the headers change.  the options property seems to be how it is done in the axios documentation...  are there any other things that we should try?

nevermind...  it turned out that the second way above was, in fact, correct but that the server with the api had not been set up to accept the 'OPTIONS' request header...


Benchmark numbers

Thanks for this amazing work!
Do you have benchmark numbers for simple things like 10 H20 in 6-31G or STO-G and B3LYP, comparing the running time of CPU and GPU implementation?
If not, is there any reason for why? Would it take a lot of work to produce the benchmarks?

It looks like a 3x speed-up from  Intel(R) Xeon(R) CPU @ 2.00GHz to Tesla T4.
Question 0. Do you get different numbers?
Example: 10 H2O molecules in STO-3G with RKS/B3LYP
  gpu		  cpu
6.974899	19.121617
6.958666	22.960514
6.905839	20.869292
6.878995	18.451716
7.138914	18.788693

Example: Benzene (C6H6) in 6-31G** with RKS/B3LYP
  gpu		  cpu
5.718811	10.618403
5.807300	10.500370
5.857789	10.442052
5.990742	10.871001
5.748997	10.544211

We haven't published any benchmark yet. The performance is improving in new releases. The performance with a small basis set is usually better than a large basis set on GPU, as you have shown. 3x speedup with Tesla T4 is not bad.

Benchmarking data is added, and will be updated.


add ldap healthcheck

@rickbergfalk I think this will make the testing more robust; it verifies LDAP docker service is up and running before starting the tests.

Also, it seemds the docker image changed the default ports, I guess this is what broke the CI
https://github.com/rroemhild/docker-test-openldap/commit/adb4650727e0123c7c24c7d7ce8609d12384a29b#diff-dd2c0eb6ea5cfc6c4bd4eac30934e2d5746747af48fef6da689e85b752f39557


Node inspect

Requests

https://serverless-stack.slack.com/archives/C01JVDJQU2C/p1634447270360600?thread_ts=1634297371.349000&cid=C01JVDJQU2C

We are transition this repo to https://github.com/sst/v2 and are closing this issue for now. If it is still relevant please reopen it there - sorry for the trouble


Add dog API Postman collection file

This PR contains a Postman Collection .json file with tests for the DOG API

Good Job David on this assignment!

I like the comments on your commits they are descriptive.
The PR Title is also descriptive.


📊 Add diagram of data model

[ ] Document the current state of the data model in a (ER) diagram
[ ] Investigate auto-generating this thing. Can it be produced via GitHub Action and added to README?

A UML-diagram can be manually generated with RubyMine.
Even though it is not as automated as a GitHub Action, it may be interesting in case, we have problems doing this with a GitHub Action.
https://www.jetbrains.com/help/ruby/creating-diagrams.html

That info should go into the README!

It will. I just wanted to write it down quickly in order to not forget it.

It's in the README, thanks


json.Number doesnt supoprt NaN / INF

What version of Go are you using (go version)?

$ go version
go version go1.15.5 windows/amd64

Does this issue reproduce with the latest release?
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
amd64

What did you do?
json.Number doesnt support NaN and INF which are supported in json.

What did you expect to see?
A check or conversion for those.
What did you see instead?
An error when marshalling.

json.Number doesnt support NaN and INF which are supported in json.

No, NaN and Infinity are not part of JSON.

Duplicate of #3480


Google Talent Job Search PERMISSION_DENIED

Hi,
i'm trying to use this library to search on Google Job and replace the old library but without success. With the old library, the authorization process works successfully but not with this library.
My credentials are working and has all the permissions.
This is my code
$jobServiceClient = new JobServiceClient([
              'credentials'       => json_decode(file_get_contents(resource_path('talent_api_key.json')), true),
              'credentialsConfig' => [
                        'scopes' => 'https://www.googleapis.com/auth/jobs',
                ],
]);
$requestMetadata = new RequestMetadata();
$requestMetadata->setDomain('XXXXX');
$requestMetadata->setUserId('UNKNOWN');
$requestMetadata->setSessionId('UNKNOWN');

 $pagedResponse = $jobServiceClient->searchJobs('projects/XXXX', $requestMetadata, [
                'jobQuery'            => $query,
                'disableKeywordMatch' => true,
            ]);

This is the error I receive:
{
    "message": "The caller does not have permission",
    "code": 7,
    "status": "PERMISSION_DENIED",
    "details": []
}

Any help is appreciated :)

Hi @fraparisi 👋,
One quick note, which is unrelated - the credentials key accepts just the path to the key file as well, so you could omit the json_decode/file_get_contents calls if you'd like.
On to your permissions issue...

Is talent_api_key.json a service account?
Have you tried also adding https://www.googleapis.com/auth/cloud-platform as a scope?

Hi @dwsupplee ,

yes talent_api_key.json is a service account that actually works

yes, before I have both but nothing change.

I just tested the snippet locally with a service account which has the Cloud Talent API enabled and the request went through successfully. Is it possible the permissions on the service account may have been modified by someone else since last used?

Hi @dwsupplee,
thank you for trying. As of now, the services account is setted as owner. I tried to add the role of administrator for Google Talent but without success.
There is some other settings that should be enabled?
Because with this library https://github.com/googleapis/google-api-php-client is working.

@fraparisi, owner role should do the trick as far as I'm aware.
Could you try a few things?:

Recreate the service account credentials file
Attempt to authenticate using an environment variable like so:

require 'vendor/autoload.php';

use Google\Cloud\Talent\V4beta1\JobServiceClient;
use Google\Cloud\Talent\V4beta1\RequestMetadata;

putenv('GOOGLE_APPLICATION_CREDENTIALS=/path/to/service/account.json');

$jobServiceClient = new JobServiceClient();
$requestMetadata = new RequestMetadata();
$requestMetadata->setDomain('XXXXX');
$requestMetadata->setUserId('UNKNOWN');
$requestMetadata->setSessionId('UNKNOWN');

$pagedResponse = $jobServiceClient->searchJobs('projects/XXXX', $requestMetadata);

Hi @fraparisi, any luck with @dwsupplee's most recent suggestions?

Hi @jdpedrie and @dwsupplee , using another service account is working like a charm but i don't understand why with the other service account is not working, they have the same permissions :(  .
After make it work, I found another problem: setting 'disableKeywordMatch' options to true seems that doesn't take effect on searching. Should I try to open another issue for this?

@fraparisi yes please, another issue would be ideal. Thank you!


How can i change the default route of /home?

I would like to change the default route of /home after login without changing the src. How can i do that?

Have you try to modify routes.php?
Route::get('home', '......Controller@method');

Yup i did, but the postLogin keeps going to home

See http://laravel.com/docs/5.1/authentication#included-authenticating you can set:
protected $redirectPath = '/dashboard';


Trained model of SE-SSD

Hi~, your work is very awesome. But when I use the trained model you provide (https://drive.google.com/file/d/1M2nP_bGpOy0Eo90xWFoTIUkjhdw30Pjs/view?usp=sharing) to evaluate val set (by running "python test.py"), I get the results as follow:
Evaluation official_AP_11: car AP(Average<EMAIL_ADDRESS>0.70, 0.70:
bbox AP:90.61, 89.47, 89.02
bev  AP:89.94, 88.11, 87.44
3d   AP:88.44, 79.07, 78.27
aos  AP:90.51, 89.10, 88.46
Evaluation official_AP_40: car AP(Average<EMAIL_ADDRESS>0.70, 0.70:
bbox AP:96.27, 93.00, 90.56
bev  AP:93.25, 89.64, 87.23
3d   AP:89.73, 83.08, 80.57
aos  AP:96.12, 92.55, 89.97
Is the trained model a checkpoint of CIA-SSD or SE-SSD? The results of SE-SSD you provide is as follow:
AP_11: car AP(Average<EMAIL_ADDRESS>0.70, 0.70:
bbox AP:98.72, 90.10, 89.57
bev  AP:90.61, 88.76, 88.18
3d   AP:90.21, 86.25, 79.22
aos  AP:98.67, 89.86, 89.16
AP_40: car AP(Average<EMAIL_ADDRESS>0.70, 0.70:
bbox AP:99.57, 95.58, 93.16
bev  AP:96.70, 92.15, 89.74
3d   AP:93.75, 86.18, 83.50
aos  AP:99.52, 95.28, 92.69
Can you provide a checkpoint of the above results?  I can’t train SE-SSD because of many environmental issues. Thanks very much!

Can you provide the model by baidu drive for me, I cant use the google drive. Thanks!@WWW2323

I have no baidu drive, you can give me your email if you need model. @shxzhao

<EMAIL_ADDRESS>Thanks!@WWW2323

I am not sure if I train the model in a right way. I want to use se-ssd model in my work but the result trained by myself  is not good as expected, can you provide a checkpoint of the results mentioned by @WWW2323 ? Thanks!

Try this link if you can get google drive, or give me your email, and i seed you the model.

Thanks！
is the model in google drive the final one trained by se ssd framework or the initial model for teacher and student model？
------------------ Original ------------------
From: WWW2323 @.>
Date: Sun,Aug 15,2021 11:57 PM
To: Vegeta2020/SE-SSD @.>
Cc: lihe ding @.>, Comment @.>
Subject: Re: [Vegeta2020/SE-SSD] Trained model of SE-SSD (#27)
Try this link if you can get google drive, or give me your email, and i seed you the model.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or unsubscribe.

The model is provided by author in README.md. It is the initial model, not the final model.

Thank you
------------------ 原始邮件 ------------------
发件人:                                                                                "Vegeta2020/SE-SSD"                                                                                @.>;
发送时间: 2021年8月16日(星期一) 凌晨0:23
@.>;
<EMAIL_ADDRESS>主题: Re: [Vegeta2020/SE-SSD] Trained model of SE-SSD (#27)
The model is provided by author in README.md. It is the initial model, not the final model.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or unsubscribe.


Changed the Cursor Animation to INDIAN TRICOLOR Theme and ADDED IT TO ALL WEBPAGES (which were without cursor Effect)

Changed the Cursor Animation to INDIAN TRICOLOR Theme and ADDED IT TO ALL WEBPAGES (Which were Without Cursor Animation Effect)
(BEFORE):
https://github.com/user-attachments/assets/12328a71-d6d7-4714-8c88-fc2e2a493be0
ALSO, So Many Pages were Without Cursor Animation Effect, So also Added Cursor Animation Effect to All Such Pages :
Some of Them Are :

 AFTER:

https://github.com/user-attachments/assets/9d542abf-de82-40ad-9d7e-b7dca099aae6
High Quality Video:
https://github.com/user-attachments/assets/a52c57ae-fc1a-4fe5-8a6e-97e34a18f080

Mam, Please Don't Close the Pull Request if it Shows RESOLVE CONFLICTS, Instead Reply ME in Such Case and Give Me Few Hours of Time in case I haven't Seen it, for Resolving Conflicts, and I will Reply Back when resolved conflicts and then Merge it, but Please don't close it. ( Bcz we just have to remove <<<<<  and ------ kind of tags that github by errors takes in the commited file, so i will remove it, if it happens !)

Related Issue
[Cite any related issue(s) this pull request addresses. If none, simply state “None”]
Fixes:  #(issue no.)
Description
[Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.]

Type of PR

[ ] Bug fix
[ ] Feature enhancement
[ ] Documentation update
[ ] Other (specify): _______________

Screenshots / videos (if applicable)
[Attach any relevant screenshots or videos demonstrating the changes. Make sure to attach before & after screenshots in your PR.]
Checklist:

[ ] I have made this change from my own.
[ ] I have taken help from some online resources.
[ ] My code follows the style guidelines of this project.
[ ] I have performed a self-review of my own code.
[ ] I have commented my code, particularly in hard-to-understand areas.
[ ] I have made corresponding changes to the documentation.
[ ] My changes generate no new warnings.
[ ] I have tested the changes thoroughly before submitting this pull request.
[ ] I have provided relevant issue numbers and screenshots after making the changes.

@PriyaGhosal Please Review My Changes and Merge it by Assigning Labels to It !!!
( Mam, Please Don't Close the Pull Request if it Shows RESOLVE CONFLICTS, Instead Reply ME in Such Case and Give Me Few Hours of Time in case I haven't Seen it, for Resolving Conflicts, and I will Reply Back when resolved conflicts and then Merge it, but Please don't close it. )

@PatelHarsh2006 Please see the conflicts . Resolve the conflicts .

@PriyaGhosal Conflicts are Resolved ! Thank You Mam, for Your Patience !

@PatelHarsh2006 Please see the conflicts .

@PriyaGhosal Conflicts are Resolved !!!

@PriyaGhosal Mam, Can You Please Guide me on how can I Correct these Deployment failed Issue that has occured in this Pull Request

@PriyaGhosal Conflicts have been Resolved ( Sorry Mam, for the Inconvinence, Because so many files were changed so it happening that that shows me 3-4 files Resolve Conflicts when I do it and You try to Again Merge it again shows me another 4-5 files for resolving Conflicts and not all at a time but once all file will get conflicts resolved you will be able to merge so please keep trying to merge so that it keep showing me resolve conflicts, Otherwise it keeps showing me no conflicts in merging the file, Hope you Understand the Problem and try to cooperate with it )

@PatelHarsh2006 Please look into conflicts

@PriyaGhosal  Finally Mam, the Conflicts are resolved

@PriyaGhosal Please merge it by Assigning Labels to it !

@PatelHarsh2006

@PriyaGhosal Conflicts have been Resolved

@PriyaGhosal Conflicts are resolved

@PatelHarsh2006 In main page cursor is not working other pages its working

@PriyaGhosal Mam Can U Please Show Me Video what's Exactly the Problem is !

@PatelHarsh2006 Cursor is not uniform as main page will have sky cursor colour and other would have tricolour cursor

@PriyaGhosal Yes this Sky Color was before(my new changes) thats why it might be showing ( while other pages were not having any effect ), as You have not merge it yet. Mam, You can See in my video ( uploaded at the time of PR (👆)) index file also have tricolor effect only.

@PatelHarsh2006 In main page tricolour cursor is not showing

@PatelHarsh2006 Are you working on it

@PriyaGhosal Yes Mam, I am Working on it !

@PriyaGhosal Mam, Please Check If It is Working Now or Not ?

@PatelHarsh2006 no in main page tricolour cursor is not working

@PatelHarsh2006 it is showing conflicts

@PriyaGhosal Conflicts have been resolved

@PatelHarsh2006
Great contribution ! 🎉 Your pull request has been successfully merged! Also Take a moment to ⭐ Star the repository if you haven't already.


Load summary

What's in this PR?
Created loader.py option to load voter report summary in using Pentaho.
References
Progress on: #224

This is worth a squash merge to clean up the history because of all of the extra commits

Cherry picked this commit after squashing the branch.