Multiple SNI

Thank you for your wonderful software.
Is it possible to use multiple SNI ?

Now we don't support it. Is there some reasons for using multiple SNIs?
If we support it, we may have to allow users custom selection strategy like a load balancer. For example random, but is it really help anti-detection?

Something like port hopping will do, for now I run multiple instances.
On Fri, Jan 6, 2023, 7:22 AM ihc童鞋@提不起劲 @.***> wrote:

Now we don't support it. Is there some reasons for using multiple SNIs?
If we support it, we may have to allow users custom selection strategy
like a load balancer. For example random, but is it really help
anti-detection?
—
Reply to this email directly, view it on GitHub
https://github.com/ihciah/shadow-tls/issues/51#issuecomment-1373109371,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABN7YNIS7AKITTAH6UMMCFLWQ6JGPANCNFSM6AAAAAATEEQGQE
.
You are receiving this because you authored the thread.Message ID:
@.***>

It can be both, using a single sni can put it a risk of detection,
switching in between multiple SNIs might help them stay unfiltered.
On Fri, Jan 6, 2023, 9:45 AM ihc童鞋@提不起劲 @.***> wrote:

I see. You mean not multiple SNI for one backend, but multiple backend. It
is right?
—
Reply to this email directly, view it on GitHub
https://github.com/ihciah/shadow-tls/issues/51#issuecomment-1373189965,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABN7YNMZCDEV6U7QFBUSVFDWQ62AXANCNFSM6AAAAAATEEQGQE
.
You are receiving this because you authored the thread.Message ID:
@.***>

Multiple SNI is supported now.

Thank you very much
On Fri, Feb 3, 2023, 1:49 PM ihc童鞋@提不起劲 @.***> wrote:

Multiple SNI is supported now.
—
Reply to this email directly, view it on GitHub
https://github.com/ihciah/shadow-tls/issues/51#issuecomment-1415618126,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABN7YNKE4VDYKGUPA6UL5TLWVTLUJANCNFSM6AAAAAATEEQGQE
.
You are receiving this because you modified the open/close state.Message
ID: @.***>


Undefined is not a function

When i try to get https://chatmanager.pro, cloudscraper throws the error:

js2py.internals.simplex.JsException: TypeError: 'undefined' is not a function

And logging:

ERROR:root:Error executing Cloudflare IUAM Javascript. Cloudflare may have changed their technique, or there may be a bug in the script.
ERROR:root:"https://chatmanager.pro" returned an error. Could not collect tokens.

Code:

import cloudscraper
scraper = cloudscraper.create_scraper()
scraper.get_tokens
<bound method CloudScraper.get_tokens of <class 'cloudscraper.CloudScraper'>>
scraper.get_tokens('https://chatmanager.pro')

Other sites working

Works fine for me....
can you please scraper.debug=True before you scraper.get_tokens() and pastebin the whole debug please ... as i can't replicate the issue...

I had the same error with the site https://japscan.to.
Adding 'br' in the Accept-Encoding header corrected the problem.
I hope this can help.

but BR is in the accept encoding... brolti is enabled by default as long as you have the brotli library installed?!

@valos can you debug for me with and without please?!

Also.. I've used japscan.to many times to test with, and never had an issue... can you guys give me debug logs... as if there is a problem i'd rather resolve it, than have undocumented hacky work arounds... cheers :)

Works fine for me.... in py2 and py3
can you please scraper.debug=True before you scraper.get_tokens() and pastebin the whole debug please ... as i can't replicate the issue...
Too strange, problem solved when i use torsocks, but japscan.to dont work, log for:
https://pastebin.com/AAZcsvYf

Thanks I'll go over the debug in awhile and get back to you if thats ok?

Strange, it does not work anymore this morning. It is therefore random.
Several tries (a dozen), only one success.
Here is a debug log: https://pastebin.com/Q89rmsTA

Interesting... yea I can replicate under py3 not under py2... let me investigate.

hrrm this seems to be directly related to js2py... trying to work it out as if i use nodejs via
print (scraper.get_tokens('https://www.japscan.to/search/', interpreter = 'nodejs'))

it's fine

@valos , @ResQNetM from what I can determine, its something to do with js2py's jsunfuck code, we (@pro-src ) and myself thought it was resolved with @pro-src's PR to @PiotrDabkowski repo https://github.com/PiotrDabkowski/Js2Py/pull/157
More investigation into what exactly is breaking is required... however I have put a bypass in place that does a manual jsunfuck before it sends it over to js2py... from my tests it resolves the issue you having, can you please let me know if this temporary resolves it for you.
Thanks.

One solution is to simply include the polyfills that define the missing JS functionality. One example could be String.prototype.italics, this is needed by jsfuck but because italics is not part of ECMA 5.1 it is not defined in Js2Py.

ok i traced it to
Function("return escape")()(("")["italics"]())[2]

which translates to C
however.. it would appear the polyfill is not working for "italics"

Hi @PiotrDabkowski thanks for responding, sorry mate, turns out it's our issue not yours due to the polyfill, spent more time investigating.. its 2am for me atm ;(

@PiotrDabkowski in regards to
js2py.eval_js('function italics (str) {return "" + this + ""; };Function("return escape")()("")["italics"]()')

any inside as to why that would not be working?

Your JS code is wrong. You need to add the method to the string prototype:
js2py.eval_js('function italics (str) {return "" + this + ""; };String.prototype.italics=italics;Function("return escape")()("")["italics"]()')

@PiotrDabkowski is absolutely correct. italics is a String.prototype method. :laughing:

@PiotrDabkowski Would you ever consider adding https://tc39.github.io/ecma262/#sec-additional-ecmascript-features-for-web-browsers ?
italics (deprecated) https://tc39.github.io/ecma262/#sec-string.prototype.italics
Similar methods: https://tc39.github.io/ecma262/#sec-additional-properties-of-the-string.prototype-object

I'm going to be that the answer is no and for that reason. Abandon js2py for this purpose... lol

Using core-js is an option as well, it can normalize the runtime: https://github.com/zloirock/core-js/tree/master/packages/core-js/es/string
Which is essentially what you'd have to use if CF ever starts using es6 features since babel uses core-js under the hood and the only way to run es6 in js2py is to transpile down to es5 using babel or similar.

You can even use js2py.eval_js6 to evaluate js6 code. It uses babel js translated to python via js2py.

@PiotrDabkowski I know it's possible to compile<EMAIL_ADDRESS>using js2py but I'm curious as to how you would then reuse the compiled code with js2py. Do you mind giving me an example?

@PiotrDabkowski I just looked at the code for translate_es6_to_es5 as an example. I've got it figured out.


pull request for e2e test at 11/11/2016 16:15:09

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

optest/docs/updated_at.md
:white_check_mark:Succeeded

Details

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Install LLVM 6.0 in docker image and reenable llvm-hs

[x] Meaningful commit message - please not Update build-constraints.yml
[x] Some time passed since Hackage upload
[x] I’ve built the docker image and built llvm-hs-pure-6.0.0 and llvm-hs-6.0.0 (fetched via stack unpack, for llvm-hs-6.0.0 I added llvm-hs-pure-6.0.0 to extra-deps) in the docker image using nightly-2018-03-14 and ran the tests of both.

Thanks for being so thorough.


[WIP][CORE] Fix Spark History Server UI

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

Was this patch authored or co-authored using generative AI tooling?

Please feel free to ping me on your PR if you want to proceed.

BTW, both Chrome and Safari Browser Developer tool doesn't give any warnings or error with this kind of module issues. I'm starting to worry about any UI issue due to the module change.

I believe this pain point for migration is mainly caused by eslint-disable no-unused-vars; otherwise, we can take care of every function that needs to be exported and covered in the js tests

Hi @dongjoon-hyun, I have created #44931 to fix the history page. Could you verify it and see if the problems we try to fix are arecomplementary or the same.

Great. Thank you! Sure.

I close this in favor of #44931 .


(fix, docs): adapt all the middle content we have on the docs product

We don't really cover much in the docs about Ferns docs product. This PR attempts to change that.

Comparing

Fern to Mintlify
Fern to ReadMe

Opinion: the showcase cards should tell a user what to look for. (e.g., Primer -> Versioning)

Getting Started

Quickstart
Project Structure (docs.yml, fern folder, fern.config.json, GitHub as CMS)
Showcase

Building your Docs

Navigation

Sections
Tabs
Versions
API Reference
Search

Customization

Theme (includes colors, light/dark mode)
Fonts
Layout (widths, heights, placement)
[pro] Custom CSS
[pro] Custom JS

Writing Content

Using Markdown
Using MDX/JSX
Frontmatter
Reusable Snippets
Versioning

Previewing

Local Preview
PR Previews

API Reference

Using OpenAPI
Using Fern Definition
Using MDX
API Playground
API Key Injection

Custom Domain

Custom Subdomain
Custom Subpath

Features

Search by Algolia
AI Chatbot
Protect Your Docs

Password-protected
SSO

Connecting Analytics

Components

Built-in Components
Custom Components

Comparing

Fern to Mintlify
Fern to ReadMe

turning this into docs.yml:
  - tab: docs
    layout:
      - section: Getting Started
        contents:
          - page: Quickstart
            path: ./pages/docs/getting-started/quickstart.mdx
          - page: Project Structure
            path: ./pages/docs/getting-started/project-structure.mdx
          - page: Showcase
            path: ./pages/docs/getting-started/showcase.mdx
      - section: Building your Docs
        contents:
          - section: Navigation
            contents:
              - page: Sections
                path: ./pages/docs/building-your-docs/navigation/sections.mdx
              - page: Tabs
                path: ./pages/docs/building-your-docs/navigation/tabs.mdx
              - page: Versions
                path: ./pages/docs/building-your-docs/navigation/versions.mdx
              - page: API Reference
                path: ./pages/docs/building-your-docs/navigation/api-reference.mdx
              - page: Search
                path: ./pages/docs/building-your-docs/navigation/search.mdx
          - section: Customization
            contents:
              - page: Theme
                path: ./pages/docs/building-your-docs/customization/theme.mdx
              - page: Fonts
                path: ./pages/docs/building-your-docs/customization/fonts.mdx
              - page: Layout
                path: ./pages/docs/building-your-docs/customization/layout.mdx
              - page: Header & Footer [pro]
                path: ./pages/docs/building-your-docs/customization/header-footer.mdx
              - page: Custom CSS [pro]
                path: ./pages/docs/building-your-docs/customization/custom-css.mdx
              - page: Custom JS [pro]
                path: ./pages/docs/building-your-docs/customization/custom-js.mdx
          - section: Writing Content
            contents:
              - page: Using Markdown
                path: ./pages/docs/building-your-docs/writing-content/markdown.mdx
              - page: Using MDX/JSX
                path: ./pages/docs/building-your-docs/writing-content/mdx-jsx.mdx
              - page: Frontmatter
                path: ./pages/docs/building-your-docs/writing-content/frontmatter.mdx
              - page: Reusable Snippets
                path: ./pages/docs/building-your-docs/writing-content/reusable-snippets.mdx
              - page: Versioning
                path: ./pages/docs/building-your-docs/writing-content/versioning.mdx
          - section: Previewing
            contents:
              - page: Local Preview
                path: ./pages/docs/building-your-docs/previewing/local-preview.mdx
              - page: PR Previews
                path: ./pages/docs/building-your-docs/previewing/pr-previews.mdx
          - section: API Reference
            contents:
              - page: Using OpenAPI
                path: ./pages/docs/building-your-docs/api-reference/openapi.mdx
              - page: Using Fern Definition
                path: ./pages/docs/building-your-docs/api-reference/fern-definition.mdx
              - page: Using MDX
                path: ./pages/docs/building-your-docs/api-reference/using-mdx.mdx
              - page: API Playground
                path: ./pages/docs/building-your-docs/api-reference/api-playground.mdx
              - page: API Key Injection
                path: ./pages/docs/building-your-docs/api-reference/api-key-injection.mdx
          - section: Custom Domain
            contents:
              - page: Custom Subdomain
                path: ./pages/docs/building-your-docs/custom-domain/custom-subdomain.mdx
              - page: Custom Subpath
                path: ./pages/docs/building-your-docs/custom-domain/custom-subpath.mdx
      - section: Features
        contents:
          - page: Search by Algolia
            path: ./pages/docs/features/search-algolia.mdx
          - page: AI Chatbot
            path: ./pages/docs/features/ai-chatbot.mdx
          - section: Protect Your Docs
            contents:
              - page: Password-protected
                path: ./pages/docs/features/protect-your-docs/password-protected.mdx
              - page: SSO
                path: ./pages/docs/features/protect-your-docs/sso.mdx
          - page: Connecting Analytics
            path: ./pages/docs/features/connecting-analytics.mdx
      - section: Components
        contents:
          - page: Built-in Components
            path: ./pages/docs/components/built-in.mdx
          - page: Custom Components
            path: ./pages/docs/components/custom.mdx
      - section: Comparing
        contents:
          - page: Fern to Mintlify
            path: ./pages/docs/comparing/fern-to-mintlify.mdx
          - page: Fern to ReadMe
            path: ./pages/docs/comparing/fern-to-readme.mdx

Getting Started

Quickstart
Project Structure (docs.yml, fern folder, fern.config.json, GitHub as CMS)
Showcase

Building your Docs

Navigation

Sections
Tabs
Versions
API Reference
Search

Customization

Theme (includes colors, light/dark mode)
Fonts
Layout (widths, heights, placement)
[pro] Header & Footer
[pro] Custom CSS
[pro] Custom JS

Writing Content

Using Markdown
Using MDX/JSX
Frontmatter
Reusable Snippets
Versioning

Previewing

Local Preview
PR Previews

API Reference

Using OpenAPI
Using Fern Definition
Using MDX
API Playground
API Key Injection

Custom Domain

Custom Subdomain
Custom Subpath

Features

Search by Algolia
AI Chatbot
Protect Your Docs

Password-protected
SSO

Analytics

Google Analytics
Segment
Mixpanel
PostHog

Integrations

GitHub
Intercom
HubSpot
Slack

SEO

Components

Built-in Components
Custom Components

Comparing

Fern vs Mintlify
Fern vs ReadMe


plac should use at least version 1.20

in yte the @plac.flg decorator is used. There is a the moment no restriction on the version of plac.
This might relate to https://github.com/snakemake/snakemake/issues/2276

see also https://github.com/conda-forge/yte-feedstock/pull/23


Errors using the "custom" theme in DSpace 7.2

Describe the bug
When using the custom theme in DSpace 7.2, I see errors in the browser's console:
ERROR TypeError: Cannot read properties of undefined (reading 'injector')
    at NavbarComponent_ng_container_15_Template (navbar.component.html:9:109)
    at executeTemplate (core.js:9614:1)
    at refreshView (core.js:9480:1)
    at refreshEmbeddedViews (core.js:10605:1)
    at refreshView (core.js:9504:1)
    at refreshComponent (core.js:10651:1)
    at refreshChildComponents (core.js:9277:1)
    at refreshView (core.js:9530:1)
    at refreshEmbeddedViews (core.js:10605:1)
    at refreshView (core.js:9504:1)

This error is repeated multiple times.
The site looks like I would expect it should, but when I make any search, I do not see any results, filters, ...

To Reproduce
Steps to reproduce the behavior:

Checkout dspace-7.2
Copy config/config.example.yml to config/config.dev.yml
Edit config/config.dey.yml and change themes.name to 'custom'
Edit docker/docker-compose.yml to set api7.demo.org as backend
Change directory into docker and run docker-compose build --no-cache && docker-compose up -d && docker-compose logs -f
When everything is running, open a browser, go to localhost:4000 and Open your browser's console.

Expected behavior
No error should show up in the browser's console when using an the custom theme without any changes. Opening the search should work normally.

@pnbecker : After further testing, I am able to reproduce this error. The reason I thought it worked is that I never see this error on the Homepage.  However, if I click on a Community, then I do see that error.
I also see a different (but possibly related) error in my DevTools Console if I attempt to run a search (and no search results  page appears blank in the UI):
ERROR NullInjectorError: R3InjectorError(e)[InjectionToken searchConfigurationService -> InjectionToken searchConfigurationService -> InjectionToken searchConfigurationService -> InjectionToken searchConfigurationService]:
  NullInjectorError: No provider for InjectionToken searchConfigurationService!

Pulling this onto the 7.3 board for analysis & flagging as high priority.  @artlowel , would you or someone on your team have a chance to look at this?  It looks like it's specific to the custom theme, as I'm not seeing this same behavior with the dspace theme.

This provider is missing from the custom themed component, adding it solves the main issue.
Since this is theme-related & minor I'll add it on to #1512 tomorrow.
The undefined injector issue is something else altogether

Sometimes (some of) the navbar items fail to render until you click the page
Adding a ?-check when accessing the injector here seems to solve this; I'm not seeing the errors anymore and the navbar always loads properly now.
Don't know if this fits in the theme PR though, on the other hand it's a one-character fix -- where should this go?

@ybnd : Since that injector issue is a one-line fix, I'm OK with simply adding it to your existing PR.  Other PRs sometimes cleanup small, unrelated bugs in a similar manner...as sometimes developers just stumble on something else while creating the PR.  Just add a note about it in the PR description.

Solution by @ybnd solves this issue. Thanks a lot!

@ybnd thank you!

For the record, this issue was fixed by these two commits (in a larger PR):

https://github.com/DSpace/dspace-angular/commit/fba1dfb689b18263b5c7ef9e92f301f6d2e2b528
https://github.com/DSpace/dspace-angular/commit/2830da955739b61c91c15f587051b0d75f4e5464


pretrained models on objects365

Could you please release the pretrained models on objects365 with HGNetv2 backbone?

This model has not been trained yet. You can star this repo, keep following news


Build broken with latest bcc

The source of the problem was how BCC loads the bpf.h file. It used to get it from a project folder called compat, but now it's loading it from /usr/include/linux/bpf.h.
If the user tries to run cgroup in an old kernel there will an error on semantic_nalyser.cpp.

Makes sense, thanks!


SSC covariance using halo model response

This PR will implement the super-sample covariance term or the power spectrum covariances using Eq. A13 of https://arxiv.org/pdf/1601.05779.pdf to calculate the power spectrum response.

Pull Request Test Coverage Report for Build 569642635

13 of 17 (76.47%)  changed or added relevant lines in 2 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.09%) to 96.651%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

pyccl/halos/halo_model.py
1
5
20.0%

Totals

Change from base Build 569152478:
-0.09%

Covered Lines:
3694

Relevant Lines:
3822

💛  - Coveralls

@damonge @c-d-leonard This should be ready for review now I think.

@carlosggarcia can you take a look?

I think we responded to everything @carlosggarcia . Thanks for reviewing!

Thanks @carlosggarcia !


Add example notebook of change of variable in HMC

Hello Team,
In HMC, the latent variable must be in an unconstrained space. Perhaps stan, pymc & numpyro are doing the change of variable trick under the hood. In BlackJAX we need to apply this trick in the joint_logprob() function manually and I haven't seen an example of the same in the documentation.
However, In toy examples (i.e - coin toss problem, linear regression), I don't see much difference between constrained and unconstrained support. Thus, I have implemented a hierarchical binomial model for the rat tumor problem (hierarchical_binom_rats.ipynb), Where I've shown that if we don't use a change of variable then result are terrible.
In the above notebook, I can highlight two major things

Change of variable in HMC
How to use arviz with BlackJAX to quickly check diagnostics of MCMC.

If the above notebooks look helpful, then I can reformat the notebook and create a PR.

That looks awesome! I wanted to add a simple example with aesara/aeppl so I'll probably add it to this notebooks when merged. Looking forward to the PR!


Problem in Chrome with itemDropTarget function

This is really silly but i got a problem with Chrome (is fine in Firefox) with this function:
const itemDropTarget = {
    acceptDrop(component, item) { *
        component.setItem(item);
    }
};

It trigger this error:

Uncaught SyntaxError: Unexpected token (

Chrome doesn't like this either:
const DustbinSimple = React.createClass({
    render() {

It must be:
const DustbinSimple = React.createClass({
    render: function() {

What am i missing?
Thanks in advance.

I found what was the problem...
I needed to compile JSX code using --harmony flag with reactify/browserify:
...
bundler.transform(["reactify", {"harmony": true}]);
...

Yeah, it's ES6 syntax. It's optional but I like to use it. I actually advise you to use Babel since it's better than JSX's transformer (and also can handle JSX).

I will take a look at Babel. Thank you very much!


Fix call in aws handler to match example (and be correct)

https://github.com/slackapi/bolt-js/blob/main/examples/deploy-aws-lambda/app.js#L60
Summary
Describe the goal of this PR. Mention any related Issue numbers.
Requirements (place an x in each [ ])

[x] I've read and understood the Contributing Guidelines and have done my best effort to follow them.
[x] I've read and agree to the Code of Conduct.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


A bug in the rotate function

https://github.com/thejevans/mla/blob/cb6bb8d64c714bbfbbe6348cd0864bc3a4f6072f/mla/models.py#L57
I am looking into it. The old version work but the new one doesn't.

Never mind I found it. It is in line 113, the old cross_matrix function is the difference between skv - skv.T but here it is just skv. check  https://github.com/thejevans/mla/blob/a9b07aa6179c1ba343c01c500e5e2e2b8bdf02e4/mla/tools.py


Remaining filter behavior change after velox switch to meta velox

Backend
VL (Velox)
Bug description
Before

After

Query:
spark.sql("""
select count(ss_item_sk), ss_addr_sk, ss_ext_sales_price, ss_sold_date_sk from store_sales where IsNull(ss_addr_sk) and IsNotNull(ss_item_sk)
group by ss_addr_sk, ss_ext_sales_price, ss_sold_date_sk
""").collect

Plan Node:
-- Project[expressions: (n2_4:INTEGER, murmur3hash(42,"n0_1","n0_2","n0_3")), (n2_5:INTEGER, "n0_1"), (n2_6:DECIMAL(7,2), "n0_2"), (n2_7:INTEGER, "n0_3"), (n2_8:BIGINT, "n1_3")] -> n2_4:INTEGER, n2_5:INTEGER, n2_6:DECIMAL(7,2), n2_7:INTEGER, n2_8:BIGINT
  -- Aggregation[PARTIAL [n0_1, n0_2, n0_3] n1_3 := count("n0_0")] -> n0_1:INTEGER, n0_2:DECIMAL(7,2), n0_3:INTEGER, n1_3:BIGINT
    -- TableScan[table: hive_table, range filters: [(ss_item_sk, Filter(IsNotNull, deterministic, null not allowed))], remaining filter: (isnull("ss_addr_sk"))] -> n0_0:INTEGER, n0_1:INTEGER, n0_2:DECIMAL(7,2), n0_3:INTEGER

Before isnull  is added in https://github.com/oap-project/velox/blob/update/velox/expression/ExprToSubfieldFilter.cpp#L509, but not now.
Spark version
None
Spark configurations
No response
System information
No response
Relevant logs
No response

cc @rui-mo


Fix some rubocop offenses 1021 001

Summary
Several fixes has been made for some of the RuboCop offenses reported.
Details
The following style violations has been fixed whether completely or partially:

Style/TrailingCommaInArguments
Style/TrivialAccessors
Style/UnlessElse
Style/UnneededInterpolation
Style/UnneededInterpolation
Style/WhileUntilDo
Style/WordArray
Style/ZeroLengthPredicate

There are RoboCop's offenses reviewed but not fixed due to irrelevance like Style/VariableName for the Cyrillic variable names.
Motivation and Context
There is bunch of exceptions for the code styling tool of RoboCop to be fixed.
Here is the main issue: #1021
How Has This Been Tested?
Although only styling is being changed, there is setup of Travis  to run the proper set of tests. All the tests are green (except for the allowed to fail profiles)
Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

Great stuff @bv! Thanks a lot, it looks good to me, I will merge it ASAP.

Thanks a lot @bv (cool handle by the way!)

Thank you @nodo, @mattwynne


Compiling on alpine linux

[ 99%] Building CXX object driver/CMakeFiles/clickhouse-odbc.dir/statement.cpp.o
[100%] Linking CXX shared library clickhouse-odbc.so
/usr/lib/gcc/x86_64-alpine-linux-musl/5.3.0/../../../../x86_64-alpine-linux-musl/bin/ld: cannot find -lodbc
collect2: error: ld returned 1 exit status
driver/CMakeFiles/clickhouse-odbc.dir/build.make:304: recipe for target 'driver/clickhouse-odbc.so' failed
make[2]: *** [driver/clickhouse-odbc.so] Error 1
CMakeFiles/Makefile2:326: recipe for target 'driver/CMakeFiles/clickhouse-odbc.dir/all' failed
make[1]: *** [driver/CMakeFiles/clickhouse-odbc.dir/all] Error 2
Makefile:149: recipe for target 'all' failed
make: *** [all] Error 2

I'm using @frol's alpine-glibc image as base.
I have unixodbc-dev installed. What am I missing?
Could You provide a Dockerfile (either ubuntu, debian, alpine)?

Please try with this commit https://github.com/yandex/clickhouse-odbc/commit/37d4dd1ffc35800bae6a1c1b9ac8d80aa995d8a0

[ 99%] Building CXX object driver/CMakeFiles/clickhouse-odbc.dir/result_set.cpp.o
[ 99%] Building CXX object driver/CMakeFiles/clickhouse-odbc.dir/statement.cpp.o
[100%] Linking CXX shared library clickhouse-odbc.so
/usr/lib/gcc/x86_64-alpine-linux-musl/6.2.1/../../../../x86_64-alpine-linux-musl/bin/ld: cannot find -lodbc
collect2: error: ld returned 1 exit status
make[2]: *** [driver/CMakeFiles/clickhouse-odbc.dir/build.make:306: driver/clickhouse-odbc.so] Error 1
make[1]: *** [CMakeFiles/Makefile2:327: driver/CMakeFiles/clickhouse-odbc.dir/all] Error 2
make: *** [Makefile:150: all] Error 2

Similar

@kszucs Try searching for *odbc*.so* and *odbc*.a* inside the container after the failure. This might help to understand which part is not playing well.

Ok, meanwhile here is the dockerfile:
FROM frolvlad/alpine-glibc

RUN apk --update add build-base git unixodbc-dev cmake linux-headers

RUN git clone --recursive https://github.com/yandex/clickhouse-odbc \
 && cd clickhouse-odbc \
 && mkdir build

RUN cd clickhouse-odbc/build && cmake .. && make

/ # find . -name *odbc*.so*
./usr/lib/libodbccr.so.2
./usr/lib/libodbccr.so
./usr/lib/libodbcinst.so.2
./usr/lib/libodbc.so.2
./usr/lib/libodbc.so
./usr/lib/libodbc.so.2.0.0
./usr/lib/libodbcinst.so
./usr/lib/libodbccr.so.2.0.0
./usr/lib/libodbcinst.so.2.0.0
/ # find . -name *odbc*.a*
/ # no hit

Ehm, it just occurred to me... Why do you need glibc if you compile against musl libc?

I'm planning to use with Miniconda (later dask etc.)

kszucs: did you delete  CMakeCache.txt before recompiling?
if yes - please paste full cmake log

You can go a slightly different road. Build Anaconda package using a glibc-based distro (Miniconda relies on glibc anyway) and publish it to Conda-Forge. Next, you just install it as usual with conda install -c conda-forge ....
Yet, having the Alpine package might be also quite valuable, but I have no idea why it breaks here. I suggest you try building it using an official Alpine image as you seem not using any of the glibc hacks, and propose the Alpine package to the main repository.
Thus, I recommend going either to glibc-based Anaconda repository or to musl-based Alpine repository.

@proller I guess I don't need to, I build the dockerfile.
Here is the cmake log https://gist.github.com/db05c5300c0842559eec5a3d5d9fef41

oops, not CMakeOutput.log, please show only console output of cmake

please reproduce with:
FROM frolvlad/alpine-glibc

RUN apk --update add build-base git unixodbc-dev cmake linux-headers

RUN git clone --recursive https://github.com/yandex/clickhouse-odbc \
 && cd clickhouse-odbc \
 && mkdir build

RUN cd clickhouse-odbc/build && cmake .. && make

tried this dockerfile and anything ok: Successfully built b4a83d4c246b

After #267 works like that:
FROM frolvlad/alpine-glibc

RUN apk --update add build-base git unixodbc-dev cmake linux-headers

RUN git clone --recursive https://github.com/yandex/clickhouse-odbc \
 && cd clickhouse-odbc \
 && mkdir build

RUN cd clickhouse-odbc/build \
    && cmake -DCMAKE_INTERPROCEDURAL_OPTIMIZATION=OFF .. \
    && cmake --build . --parallel


Update QUIC-GO version

Please update QUIC implementation by Lucas Clemente. If I'm not wrong he's using Q043 that is supported by default on chromium browser

It will be updated in the next minor version soon.


Unexpected error handling request: inability to access platform

Description
Hello, I am trying to sync some work into my online databricks by running a .sh file. called source. So whenever I run the source sync.sh file, I get the below error:
Reproduction
Error: unexpected error handling request: json: cannot unmarshal number into Go struct field APIErrorBody.error_code of type string. This is likely a bug in the Databricks SDK for Go or the underlying REST API. Please report this issue with the following debugging information to the SDK issue tracker at https://github.com/databricks/databricks-sdk-go/issues.  This is likely a bug in the Databricks SDK for Go or the underlying REST API. Please report this issue with the following debugging information to the SDK issue tracker at https://github.com/databricks/databricks-sdk-go/issues. Request log:

POST /api/2.0/dbfs/mkdirs

Host:
Accept: application/json
Authorization: REDACTED
Content-Type: application/json
User-Agent: cli/0.212.0 databricks-sdk-go/0.29.0 go/1.21.0 os/linux cmd/fs_cp auth/pat
{
"path": "/User"
}
< HTTP/2.0 403 Forbidden
< * Access-Control-Allow-Headers: Authorization, X-Databricks-Azure-Workspace-Resource-Id, X-Databricks-Org-Id, Content-Type
< * Access-Control-Allow-Origin: *
< * Cache-Control: no-cache, no-store, must-revalidate
< * Content-Length: 70
< * Content-Type: application/json; charset=utf-8
< * Date: Wed, 13 Mar 2024 06:06:37 GMT
< * Expires: 0
< * Pragma: no-cache
< * Server: databricks
< * Vary: Accept-Encoding
< * X-Databricks-Reason-Phrase: Invalid access to Org: xxxxx
< {
<   "error_code": 403,
<   "message": "Invalid access to Org: xxxxx"
< }

I have my environment variables such as token number etc. in a file called .env.example which is super fine, I have crosschecked numerous times and it is all good. However, running source sync.sh no longer works.
Expected behavior
Running source sync.sh should start syncing some of my files to databricks online. This additional step is required outside the normal databricks extension.

Do you have an IP access list enabled for your workspace per chance?

Hello, in fact its company work, but if you could tell me where to access it, I will look it up and get back to you. No idea if that IP access list exists and just heard about it now

As best as I can tell no IP Access restrictions have been made

See this doc page for an overview of IP access lists: https://docs.databricks.com/en/security/network/front-end/ip-access-list.html

There are two things going on here:

The API response includes a number for "error_code" where the SDK expects a string. This is causing a failure when deserializing the API response, resulting in this error message. We want to follow up with the backend team to make sure their error responses are consistent with other Databricks services.
Still, your request is being rejected due to some authorization problem. IP Access lists can be one cause of this. Generally, we don't include information about why your request was rejected in the error, as it would allow an illegitimate user to gain knowledge about your workspace/account.

Hello @mgyucht I checked if my workspace could have any allowed or blocked IP address lists through the code databricks  ip-access-lists list as seen here . However, there are no IP Access lists for my account or workspace so the matter of IP address blocking is ruled out. This was the error I got in return after executing the aforementioned code: Error: default auth: metadata-service: token request: {"not_found":true}. Config: host=https:xxxxx.net, cluster_id=xxxxx, metadata_service_url=***. Env: DATABRICKS_HOST, DATABRICKS_CLUSTER_ID, DATABRICKS_METADATA_SERVICE_URL. Furthermore, when I ran the source sync.sh some days ago outside the office it worked perfectly. It was only two days ago this error came up after executing outside the office. Before it was all running fine, be it in or out of the office.

Ah interesting! Are you using the VS Code Extension? cc @fjakobs maybe there is a strange interaction going on here with metadata service.
Can you try running this in another terminal outside of VS Code?

I had the same issue @mgyucht, what worked was rerunning the command on a new terminal instance on VSCode. I am also using the dbx extension


Added Mapillary to usage list

Marathon is AWESOME!

Can one of the admins verify this patch?

Can one of the admins verify this patch?

Can one of the admins verify this patch?


autovoice after 20 seconds

Hi, how can I set autovoice to users after 20 seconds?

Duplicate of https://github.com/znc/znc/issues/1595.


NullReferenceException RenderLoop.TimerTick hiding a ContextMenu

I want to hide a context menu completely based on a property from my data source. The context menu works with the XAML below as expected but there are a lot of exceptions fired in the background by TimerTick if i do a right click on a tree view item where IsRootNode is false.
<ContextMenu IsVisible="{Binding IsRootNode}">
	<MenuItem Header="Remove"></MenuItem>
</ContextMenu

The exception shown in debugging output:
[Visual] Exception in render loop: "System.NullReferenceException: Object reference not set to an instance of an object.
   at Avalonia.Skia.FramebufferRenderTarget.CreateDrawingContext(IVisualBrushRenderer visualBrushRenderer)
   at Avalonia.Rendering.DeferredRenderer.EnsureDrawingContext(IDrawingContextImpl& context)
   at Avalonia.Rendering.DeferredRenderer.UpdateRenderLayersAndConsumeSceneIfNeeded(IDrawingContextImpl& context, Boolean recursiveCall)
   at Avalonia.Rendering.DeferredRenderer.Render(Boolean forceComposite)
   at Avalonia.Rendering.RenderLoop.TimerTick(TimeSpan time)" (Avalonia.Rendering.RenderLoop #25871395)

The complete XAML for the TreeView containing the context menu:
<TreeView x:Name="NavigationTreeView" Grid.Row="0" Grid.Column="0" Items="{Binding TreeNodes}">
	<TreeView.DataTemplates>
		<TreeDataTemplate DataType="models:TreeNode" ItemsSource="{Binding Nodes}">
			<StackPanel Orientation="Horizontal">
				<StackPanel.ContextMenu>
					<ContextMenu IsVisible="{Binding IsRootNode}">
						<MenuItem Header="Remove"></MenuItem>
					</ContextMenu>
				</StackPanel.ContextMenu>
				<Image Source="{Binding Image}"/>
				<TextBlock Margin="5,0,0,0" Foreground="Black" Text="{Binding DisplayName}"/>
				<TextBlock Margin="10,0,0,0" Foreground="Gray" Text="{Binding SizeDisplayValue, StringFormat='({0})'}" HorizontalAlignment="Right"/>
			</StackPanel>
		</TreeDataTemplate>
	</TreeView.DataTemplates>
</TreeView>

Expected behavior
No exceptions to occur.
Desktop:

OS: Windows 10
Version: 0.9.12
.NET Core 3.1

What about 0.10.0-rc1?

I tried switching to version 0.10.0-rc1 but that did not work. I get a stack overflow exception upon start which did not occur with the latest stable version. So no chance at the moment to test if the reported exception is gone with the newer version.

@lordzomat can you create minimal project to reproduce StackOverflowException issue?
Also I would recommend to use more specific <TreeView.ItemTemplate> instead of <TreeView.DataTemplates> so it will not be matching with inner content presenters. Although in your case it shouldn't be an issue, because you already have DataType specified.

@lordzomat can you create minimal project to reproduce StackOverflowException issue?
Also I would recommend to use more specific <TreeView.ItemTemplate> instead of <TreeView.DataTemplates> so it will not be matching with inner content presenters. Although in your case it shouldn't be an issue, because you already have DataType specified.

@maxkatz6 i already tried to reproduce the StackOverflowException in a test application but had no success so far. I used the same TreeView definition but with sample data. I think i have to analyze the crashing app further but i had no time yet. I will report if i have more information.
I did already a try with replacing DataTemplates to ItemTemplate and had no success, but i will try it again.

@maxkatz6 i already tried to reproduce the StackOverflowException in a test application but had no success so far. I used the same TreeView definition but with sample data. I think i have to analyze the crashing app further but i had no time yet. I will report if i have more information.
I did already a try with replacing DataTemplates to ItemTemplate and had no success, but i will try it again.

@maxkatz6 i found the issue for the StackOverflowException which is my progress dialog which crashes on the Close() call in the completed event of the BackgroundWorker.
worker.RunWorkerCompleted +=
    (s, e) =>
    {
        Dispatcher.UIThread.InvokeAsync(delegate
        {
            Close();
        });
    };

Closing the window works with the previous avalonia version, so this seems to be an bug in the new version.
Now that i found the issue for that, i could do a test with the context menu with version 0.10.0-rc1.  The NullReferenceException  seems to be gone in that version i could not reproduce it.
I have published the test application under this repo AvaloniaTestApp

@maxkatz6 i found the issue for the StackOverflowException which is my progress dialog which crashes on the Close() call in the completed event of the BackgroundWorker.
worker.RunWorkerCompleted +=
    (s, e) =>
    {
        Dispatcher.UIThread.InvokeAsync(delegate
        {
            Close();
        });
    };

Closing the window works with the previous avalonia version, so this seems to be an bug in the new version.
Now that i found the issue for that, i could do a test with the context menu with version 0.10.0-rc1.  The NullReferenceException  seems to be gone in that version i could not reproduce it.
I have published the test application under this repo AvaloniaTestApp

@lordzomat
In your ProgressWindow you have following code:
private void Execute()
{
    worker.RunWorkerAsync();
    ShowDialog(this);
}

Where you tries to open Dialog window with itself as a owner.
Window can't own itself, you need to pass another windows as a first parameter in ShowDialog method. In your case it probably should be MainWindow. Or you can use "Show" method without "Dialog" part that doesn't requires owner to be presented.

@lordzomat
In your ProgressWindow you have following code:
private void Execute()
{
    worker.RunWorkerAsync();
    ShowDialog(this);
}

Where you tries to open Dialog window with itself as a owner.
Window can't own itself, you need to pass another windows as a first parameter in ShowDialog method. In your case it probably should be MainWindow. Or you can use "Show" method without "Dialog" part that doesn't requires owner to be presented.

@maxkatz6  thanks for the hint, that did the trick. I did a few tests and i cannot reproduce the issue with 0.10.0-rc1 so i think the issue can be closed.

@maxkatz6  thanks for the hint, that did the trick. I did a few tests and i cannot reproduce the issue with 0.10.0-rc1 so i think the issue can be closed.


Multi-select filter for leaderboard contributors role

Add a role multi-select filter to the leaderboard filters.
The following choices to be present:

Open Source Contributor (if core == intern == operations == false)
Core Team (if core == true)
Intern (if intern == true)
Operations (if operations == true)

I want to work on this issue , can you please assign me !


Update README.md

Hello fellow maintainer,
I have added some standardized markdowns to the README.md to improve the docs. Also, I fixed the unnecessary ` signs in the document.
Please review and approve.

Hello @meg-huggingface
Can you please check on this once?


Added a DType==u64 check for TakeFn

Missed an assertion that take should only accept DType==u64 indices

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


zerver: Replace log_event with RealmAuditLog in do_change_avatar_fields

@timabbott please review. This pull request hasbug with length of extra_data. Sorry for dirty pull request. I don't know why 2 previous commits appear again as they have already been merged into master.

Automated message from Dropbox CLA bot
@misteraverin, it looks like you've already signed the Dropbox CLA. Thanks!

@misteraverin This looks pretty good.  Can you squash this into one commit, rebase against a current copy of master, and re-run the migrations again in your dev environment to ensure that no other migrations have hit master since your original change?

@showell  I merge migrations, but an error still appears

@misteraverin Thanks for the progress update!
Do you need help understanding the Travis output or debugging zerver.tests.test_audit_log.TestChangeAvatarFields.test_change_avatar_source?  If so, maybe find somebody on chat (including me) who can help you.

@showell Well, Actually problem is "value too long for type character varying(1)"

@misteraverin I cleaned up the unnecessary "merge" migration by regenerating migrations, added null=true and merged this as 141469399bf14d8c5539e2f71e8b6ece47b01494 and f213369e1d008c6259235024743b2153fc69192d.
Thanks @misteraverin!


[TC-DL-1.7]-GetUser Status command is not handling the Failure response

As per testplan in the GetUser Status command Configured the  userIndex value as "3f4"  ,but while running this script i am getting Following error
TestPlan Screenshot:

Teststep Screenshot:

Error SCrrenshot

execution-logs-mar24.zip

this issue is not relevant to the GetUserStatus command, created this issue wrongly hence closing this issue


Add application release notes

Add release_history json for tracking version releases
Add ReleaseNotes component to display release notes (found in user menu)

Updated modal when clicking about tab

thought of a better idea, will refactor and post new PR

changed modal to a menu, should make it easier to add future options to about tab


chore: remove important data leaking console logs from codebase 🙅🏻🔥

Related Issue
Closes #378
Description

This PR addresses the issue of logging sensitive information in the browser's development console, which poses significant security risks and potential data breaches.
The logged data includes API keys, project identifiers, and other confidential information.
By removing the logs, we ensure better data protection and reduce the risk of unauthorized access and data leaks.

Checklist

[x] My code adheres to the established style guidelines of the project.
[x] I have included comments in areas that may be difficult to understand.
[x] My changes have not introduced any new warnings.
[x] I have conducted a self-review of my code.

Please merge this PR @Gaurav-Verma07


feat(tickers): implement free functionality for tickers endpoint

Closes #9

We're currently processing your upload.  This comment will be updated when the results are available.


docs: Move selinux into image info, add toplevel gotcha

We had SELinux info but I was expecting it in the
"information about images" section, not the "building" section.  Move it, and link from the previous place.
Then add the gotcha about toplevel directories.

Hooray the control/skip-ci label seems to work as intended!

Though a messy thing here is some of those CI contexts are marked required...so we'll need to bypass branch protections for now.  Hard to deal with without some custom work for branch protection.


Initial implementation of EventSeries

This covers an initial implementation of the EventSeries features described in https://github.com/datascopeanalytics/traces/issues/229
I ended up leaving out the histogram plotting feature as creating reasonable and responsive log binned histograms of time units felt a little outside the scope of this project, though something I may yet tackle.
Would love a review for readability, test coverage, or feature suggestions!

I'm pretty sure this failed because in the dev branch I switched from coveralls to codecov for making a coverage report. Could you try making the pull request into the dev branch instead of master?


Cron job to write lunches to database tables

@thesuperRL this is what I was suggesting last week, we can land these three files and start writing the lunches to the db. If you want to make a pull request like this one we can work on it today and try to get it landed this week.


Add Hannaford

Hannaford is a grocery chain that is providing vaccinations in five states.
Looks like they have an availability checker that searches a 50 mile radius based on zip code: https://hannafordsched.rxtouch.com/rbssched/program/covid19/Patient/Advisory
https://www.hannaford.com/pharmacy/covid-19-vaccine

Was able to reprduce in postman by POSTing to https://hannafordsched.rxtouch.com/rbssched/program/covid19/Patient/CheckZipCode and an x-www-form-urlencoded body of zip=[zip]&appointmentType=5954&PatientInterfaceMode=0 where [zip] is the zip code.
The request only seems to require cookies to get through as they seem to have a timing system where a visitor is only allowed on the page for 10 min or something. not sure if this is just a user facing thing or not but If cookies are saved between requests, I have found that the first postman request (without cookies) returns an HTML page and sets the cookies. Any subsequent requests can use these cookies to get a response.
Responses seem relatively inconsistent compared to JSON, as they seem to just be a raw one-line text response of the form "There are no locations with available appointments within 50 miles of [city], [state postal abbreviation] [zip]  ." (quotation marks and extra spaces included)


Check if we could link directly to that discord user from profile

Checking if we could link directly to that user.. https://www.swipetips.com/how-to-send-a-link-to-a-discord-profile/
seems needs to be there like
https://discordapp.com/users/prachi#4004/
So this should reach @prachi00 on discord? https://discordapp.com/users/prachi#4004/
edit seems doesn't work now.
Originally posted by @yangwao in https://github.com/kodadot/nft-gallery/pull/1771#issuecomment-1013057590

username won't work here, it actually needs to be a 18-char long id

Meanwhile we added posibility to fill discord in Identity, continue in #4751


Disable external entities, includes, and entity reference expansion for SAML parsers

See https://www.owasp.org/index.php/XML_External_Entity_(XXE)_Processing

Should be merged with 4.2 and 4.1

+1 Looks like we need the same for pac4j ;-)

Sure. I'll work on the same pull for pac4j.

Thanks


feat: Support Matomo as analytics provider (self-hosted)

ty, I might close this, SPA is not tracked, so far couldn't figure out where the issue is


[elastic] Documentation: Missing description of required user roles/permissions

Problem
I'm setting up the elastic integration to monitor a managed Elastic Cloud Elasticsearch deployment.
I'm connecting to it via BasicAuth using username & password of an Elasticsearch user.
I tried using the built-in monitoring_user role for the Elasticsearch user. But get the following error:
elastic (5.1.1)
    ---------------
      Instance ID: elastic:REDACTED [ERROR]
      Configuration Source: file:/etc/datadog-agent/conf.d/elastic.yaml
      Total Runs: 7
      Metric Samples: Last Run: 495, Total: 1,980
      Events: Last Run: 1, Total: 1
      Service Checks: Last Run: 1, Total: 11
      Average Execution Time : 3.631s
      Last Execution Date : 2022-07-07 09:12:31 UTC<PHONE_NUMBER>000)
      Last Successful Execution Date : 2022-07-07 09:11:47 UTC<PHONE_NUMBER>000)
      metadata:
        version.major: 7
        version.minor: 17
        version.patch: 5
        version.raw: 7.17.5
        version.scheme: semver
      Error: 403 Client Error: Forbidden for url: https://REDACTED.psc.europe-west4.gcp.elastic-cloud.com:443/_nodes/stats
      Traceback (most recent call last):
        File "/opt/datadog-agent/embedded/lib/python3.8/site-packages/datadog_checks/base/checks/base.py", line 1120, in run
          self.check(instance)
        File "/opt/datadog-agent/embedded/lib/python3.8/site-packages/datadog_checks/elastic/elastic.py", line 108, in check
          stats_data = self._get_data(stats_url)
        File "/opt/datadog-agent/embedded/lib/python3.8/site-packages/datadog_checks/elastic/elastic.py", line 279, in _get_data
          resp.raise_for_status()
        File "/opt/datadog-agent/embedded/lib/python3.8/site-packages/requests/models.py", line 960, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://REDACTED.psc.europe-west4.gcp.elastic-cloud.com:443/_nodes/stats

When I grant the user the superuser role I get no errors:
elastic (5.1.1)
    ---------------
      Instance ID: elastic:REDACTED [OK]
      Configuration Source: file:/etc/datadog-agent/conf.d/elastic.yaml
      Total Runs: 49
      Metric Samples: Last Run: 495, Total: 2,475
      Events: Last Run: 1, Total: 1
      Service Checks: Last Run: 2, Total: 54
      Average Execution Time : 1.14s
      Last Execution Date : 2022-07-07 09:23:05 UTC<PHONE_NUMBER>000)
      Last Successful Execution Date : 2022-07-07 09:23:05 UTC<PHONE_NUMBER>000)
      metadata:
        version.major: 7
        version.minor: 17
        version.patch: 5
        version.raw: 7.17.5
        version.scheme: semver

But this is not viable from a security standpoint.
There is (or at least I couldn't find any) no documentation about the permissions that the DataDog Agent needs in https://github.com/DataDog/integrations-core/tree/master/elastic.
Expected
Documentation about required permissions and/or roles for the Elasticsearch user that is configured for use by the DataDog Agent elastic integration.

I used the following Elasticsearch permissions to get it working:
Built-in role: monitoring_user
Index: .monitoring-* & metricbeat-*
Index privileges: read, read_cross_cluster, monitor
Cluster: monitor

Hi @orlandothoeny
Thanks for your issue.
Could you tell us exactly how you are creating the role and assigning it to the user? Using the REST API offered by Elastic for it?
https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-put-role.html
https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-put-user.html

Yes I used the API, via the elasticstack Terraform provider. But you can also create that user via the Kibana UI.
Here's an excerpt from our Terraform code:
...

/** Monitoring user **/
resource "random_password" "datadog_user_password" {
  length = 32
  // Special chars might mess with DataDog Agent YAML configs
  special = false

  keepers = {
    name : ec_deployment.deployment.id
  }
}

resource "elasticstack_elasticsearch_security_user" "datadog_user" {
  username = "datadog"

  password = random_password.datadog_user_password.result
  /* We still need the "monitoring_user" user role, because we cannot assign the Kibana "Stack Monitoring" permission to our own custom "datadog" role.
  These are only available via this built-in role */
  roles = [elasticstack_elasticsearch_security_role.datadog_role.name, "monitoring_user"]

  metadata = jsonencode(local.labels)

  elasticsearch_connection {
    username  = elasticstack_elasticsearch_security_user.terraform_user.username
    password  = elasticstack_elasticsearch_security_user.terraform_user.password
    endpoints = [ec_deployment.deployment.elasticsearch[0].https_endpoint]
  }
}

resource "elasticstack_elasticsearch_security_role" "datadog_role" {
  name = "datadog"

  indices {
    names      = [".monitoring-*", "metricbeat-*"]
    privileges = ["read", "read_cross_cluster", "monitor"]
  }

  cluster = ["monitor"]
  run_as  = []

  metadata = jsonencode(local.labels)

  elasticsearch_connection {
    username  = elasticstack_elasticsearch_security_user.terraform_user.username
    password  = elasticstack_elasticsearch_security_user.terraform_user.password
    endpoints = [ec_deployment.deployment.elasticsearch[0].https_endpoint]
  }
}

Hi @orlandothoeny
DataDog Agent elastic integration documentation will be updated in the next version.


TP-859: Switch to using an in-memory SQLite export

Why
We've found it too difficult to provision enough temporary disk space on PaaS to create ~3Gb database.
What
This commit changes the export to use an in-memory database instad. We've changed wrappers to use apsw instead of the native library so that we can subsequently deserialize the database into bytes and stream it directly to S3.

Checklist

Requires migrations? No.
Requires dependency updates? Yes.

Ignore this if it's already in the PR:
There should definitely be a note / info in the README about the memory requirements, otherwise it may be surprising to devs in the future.
Worth checking roughly what this uses in top/htop ... and note the size and the ratio compared to the database size e.g. roughly 1.2x the database size 2x, 3x / whatever.
Could be useful info later, if e.g. if we end up using up all the memory.
Michal actually worked on something to stream sqlite, which could be an option in the future, if the ram requirements get big.

Ignore this if it's already in the PR:
There should definitely be a note / info in the README about the memory requirements, otherwise it may be surprising to devs in the future.
Worth checking roughly what this uses in top/htop ... and note the size and the ratio compared to the database size e.g. roughly 1.2x the database size 2x, 3x / whatever.
Could be useful info later, if e.g. if we end up using up all the memory.
Michal actually worked on something to stream sqlite, which could be an option in the future, if the ram requirements get big.

Agreed, I’ll add that.
Yes, in fact this change makes it easy to change over to that S3-based SQLite if we want to - it would just be a couple of lines to configure and swap out the virtual file system.

Codecov Report

Merging #389 (7f057d2) into master (5657f19) will decrease coverage by 0.02%.
The diff coverage is 96.72%.

@@            Coverage Diff             @@
##           master     #389      +/-   ##
==========================================
- Coverage   91.25%   91.23%   -0.03%
==========================================
  Files         274      274
  Lines       16263    16265       +2
  Branches     1317     1319       +2
==========================================
- Hits        14841    14839       -2
- Misses       1189     1192       +3
- Partials      233      234       +1

Impacted Files
Coverage Δ

exporter/sqlite/runner.py
89.09% <93.75%> (+1.85%)
:arrow_up:

exporter/sqlite/__init__.py
100.00% <100.00%> (ø)

exporter/sqlite/plan.py
96.55% <100.00%> (+0.32%)
:arrow_up:

exporter/sqlite/tasks.py
100.00% <100.00%> (ø)

exporter/tests/test_sqlite.py
97.40% <100.00%> (-0.22%)
:arrow_down:

regulations/forms.py
63.63% <0.00%> (-2.03%)
:arrow_down:

common/forms.py
66.05% <0.00%> (-1.84%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5657f19...7f057d2. Read the comment docs.


Error/Exception/etc Messages Not Encoding as Windows Unicode

What is the current behavior?

Look into Error/Exception/etc where text isn't being captured as Windows Unicode. To reproduce, try connection to the Live or Prerecorded Client without using an API Key.
Steps to reproduce

NA
Expected behavior

NA
Please tell us about your environment

Na
Other information

NA

Released https://github.com/deepgram/deepgram-dotnet-sdk/releases/tag/4.0.0-rc.1


Spike: Integration test fix

Do not merge:  example
Always buffer body

Hey Alex, can you re-open this into the branch you based it off of? Looks useful.

@nstogner I saw that you added the "always read body" logic to your branch already. If there is anything else useful, please let me know.


Added Parallax ROM font characters, fixed bugs and added features to …

…the builder

When using the ImageWriter, it is now possible to specify a file containing a translation map.
This can be used to output a certain 'codepage' for use in systems with limited memory. A map
for the parallax ROM character set is included, but ones for PETSCII and such could be made.

Some typos fixed

8x8 versions of parallax ROM characters added (mostly pseudo-graphics, U+F000 to U+F0FF)
(some have 8x16 versions)

added parallax_lines compile option for thin lines in 8x8, aswell as replacing some thick lines
with strange ones (to look more like the ROM font)

heres how those are used, btw:

make.bat for Winderps

Would be wise to split the PR into a few parts.
I'm not sure if/how I want to add the Parallax-specific glyphs yet, but the rest of the PR (bar the one note) is sound.


ResourceArea: Failed to ping bot endpoint, results to Bad Gateway 502

The Microsoft Bot Framework team prefers that "How To" questions be submitted on Stack Overflow. The official Bot Framework GitHub repository  is the preferred platform for submitting bug fixes and feature requests.
Bot Info

SDK Platform: .NET
SDK Version: 3.15
Active Channels: Web
Deployment Environment:
Deployed on Azure , Premium plan

Issue Description
For some reason, I cannot get the bot response to me, this is just the basic bot, one that comes from template of VS bot builder. But it's giving me the error of bad gateway 502.
Code Example
can't identify the issue coz it runs perfectly on emulator on locahost
Reproduction Steps

Use bot template
build and deploy to azure
test using web channel on azure

Expected Behavior
Coudn't send retry error
Actual Results
When I created the resources, I picked Web Api on "Web" category and "bot registration" on bot category

With regard to "bot registration" do you mean that you created two different azure resources, a webapp and a bot registration channel, or did you create a single bot app?

Please provide more details, otherwise this issue will be closed.

Yes both this issue has been resolved

That's good, closing this issue then.


Difference between wingpio and RPi.GPIO (Problems with DHT11)

Hello,
I want to use https://github.com/szazo/DHT11_Python and I changed the import form "import RPi.GPIO as GPIO" to  "import _wingpio as GPIO" but it just reports Error 1( Missing Data). What are the difference between RPi.GPIO and wingpio, maybe this helps to locate the error.

Hello,
Thanks for the report!  We were able to reproduce the problem you have with the DHT11 sensor.  For some reason, when running on Windows IoT core, we are not reading the full 40 bits of data from sensor.  That's why the DHT11_Python library is reporting Error 1 (Missing Data).  We are working on it and will update you as soon as possible.


Error: Undefined name 'mustBeOverridden'

Describe the bug
with  flutter_riverpod: 2.3.9, compilation displays :
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/async_notifier/auto_dispose.dart:94:4: Error: Undefined name 'mustBeOverridden'.
@mustBeOverridden
^^^^^^^^^^^^^^^^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/async_notifier/auto_dispose.dart:94:4: Error: This can't be used as an annotation; an annotation should be a reference to a compile-time constant variable, or a call to a constant constructor.
@mustBeOverridden
^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/async_notifier/auto_dispose.dart:100:4: Error: Undefined name 'mustBeOverridden'.
@mustBeOverridden
^^^^^^^^^^^^^^^^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/async_notifier/auto_dispose.dart:100:4: Error: This can't be used as an annotation; an annotation should be a reference to a compile-time constant variable, or a call to a constant constructor.
@mustBeOverridden
^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/async_notifier/base.dart:138:4: Error: Undefined name 'mustBeOverridden'.
@mustBeOverridden
^^^^^^^^^^^^^^^^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/async_notifier/base.dart:138:4: Error: This can't be used as an annotation; an annotation should be a reference to a compile-time constant variable, or a call to a constant constructor.
@mustBeOverridden
^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/async_notifier/base.dart:144:4: Error: Undefined name 'mustBeOverridden'.
@mustBeOverridden
^^^^^^^^^^^^^^^^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/async_notifier/base.dart:144:4: Error: This can't be used as an annotation; an annotation should be a reference to a compile-time constant variable, or a call to a constant constructor.
@mustBeOverridden
^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/stream_notifier/auto_dispose.dart:97:4: Error: Undefined name 'mustBeOverridden'.
@mustBeOverridden
^^^^^^^^^^^^^^^^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/stream_notifier/auto_dispose.dart:97:4: Error: This can't be used as an annotation; an annotation should be a reference to a compile-time constant variable, or a call to a constant constructor.
@mustBeOverridden
^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/stream_notifier/base.dart:115:4: Error: Undefined name 'mustBeOverridden'.
@mustBeOverridden
^^^^^^^^^^^^^^^^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/stream_notifier/base.dart:115:4: Error: This can't be used as an annotation; an annotation should be a reference to a compile-time constant variable, or a call to a constant constructor.
@mustBeOverridden
^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/notifier/auto_dispose.dart:89:4: Error: Undefined name 'mustBeOverridden'.
@mustBeOverridden
^^^^^^^^^^^^^^^^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/notifier/auto_dispose.dart:89:4: Error: This can't be used as an annotation; an annotation should be a reference to a compile-time constant variable, or a call to a constant constructor.
@mustBeOverridden
^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/notifier/auto_dispose.dart:95:4: Error: Undefined name 'mustBeOverridden'.
@mustBeOverridden
^^^^^^^^^^^^^^^^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/notifier/auto_dispose.dart:95:4: Error: This can't be used as an annotation; an annotation should be a reference to a compile-time constant variable, or a call to a constant constructor.
@mustBeOverridden
^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/notifier/base.dart:158:4: Error: Undefined name 'mustBeOverridden'.
@mustBeOverridden
^^^^^^^^^^^^^^^^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/notifier/base.dart:158:4: Error: This can't be used as an annotation; an annotation should be a reference to a compile-time constant variable, or a call to a constant constructor.
@mustBeOverridden
^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/notifier/base.dart:164:4: Error: Undefined name 'mustBeOverridden'.
@mustBeOverridden
^^^^^^^^^^^^^^^^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/notifier/base.dart:164:4: Error: This can't be used as an annotation; an annotation should be a reference to a compile-time constant variable, or a call to a constant constructor.
@mustBeOverridden
^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/stream_provider/base.dart:125:4: Error: Undefined name 'mustBeOverridden'.
@mustBeOverridden
^^^^^^^^^^^^^^^^
../../development/flutter/.pub-cache/bin/hosted/pub.dev/riverpod-2.3.9/lib/src/stream_provider/base.dart:125:4: Error: This can't be used as an annotation; an annotation should be a reference to a compile-time constant variable, or a call to a constant constructor.
@mustBeOverridden
^
Target kernel_snapshot failed: Exception
FAILURE: Build failed with an exception.

Where:
Script '/Users/user/development/flutter/packages/flutter_tools/gradle/flutter.gradle' line: 1157

What went wrong:
Execution failed for task ':app:compileFlutterBuildDebug'.

Process 'command '/Users/user/development/flutter/bin/flutter'' finished with non-zero exit value 1

Try:

Run with --stacktrace option to get the stack trace.
Run with --info or --debug option to get more log output.
Run with --scan to get full insights.

To Reproduce
flutter doctor -v                                                                                 1 ✘  4s  15:48:14 
[✓] Flutter (Channel stable, 3.7.12, on macOS 13.4.1 22F82 darwin-x64, locale fr-FR)
• Flutter version 3.7.12 on channel stable at /Users/user/development/flutter
• Upstream repository https://github.com/flutter/flutter.git
• Framework revision 4d9e56e694 (il y a 4 mois), 2023-04-17 21:47:46 -0400
• Engine revision 1a65d409c7
• Dart version 2.19.6
• DevTools version 2.20.1
[!] Android toolchain - develop for Android devices (Android SDK version 34.0.0)
• Android SDK at /Users/user/Library/Android/sdk
• Platform android-34, build-tools 34.0.0
• Java binary at: /Applications/Android Studio.app/Contents/jbr/Contents/Home/bin/java
• Java version OpenJDK Runtime Environment (build 17.0.6+0-17.0.6b829.9-10027231)
✗ Android license status unknown.
Run flutter doctor --android-licenses to accept the SDK licenses.
See https://flutter.dev/docs/get-started/install/macos#android-setup for more details.
[✓] Xcode - develop for iOS and macOS (Xcode 14.3.1)
• Xcode at /Applications/Xcode.app/Contents/Developer
• Build 14E300c
• CocoaPods version 1.11.3
[✓] Chrome - develop for the web
• Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome
[✓] Android Studio (version 2022.3)
• Android Studio at /Applications/Android Studio.app/Contents
• Flutter plugin can be installed from:
🔨 https://plugins.jetbrains.com/plugin/9212-flutter
• Dart plugin can be installed from:
🔨 https://plugins.jetbrains.com/plugin/6351-dart
• Java version OpenJDK Runtime Environment (build 17.0.6+0-17.0.6b829.9-10027231)
[✓] VS Code (version 1.81.1)
• VS Code at /Applications/Visual Studio Code.app/Contents
• Flutter extension version 3.70.0
[✓] Connected device (3 available)
• SM T970 (mobile) • R52R40AJJ6R • android-arm64  • Android 13 (API 33)
• macOS (desktop)  • macos       • darwin-x64     • macOS 13.4.1 22F82 darwin-x64
• Chrome (web)     • chrome      • web-javascript • Google Chrome 116.0.5845.110
[✓] HTTP Host Availability
• All required HTTP hosts are available

I forgot to bump the minimum meta version needed
Make sure to run flutter pub upgrade

Ok, I have this problem because i have some projects use flutter 3.7. (meta 1.8.0)
After migration to flutter 3.10, the error disappear because @MustBeOverridden flag is known

I'll pull down the version using riverpod:>=1.4.0 and update the constraint to >=1.9.0

It works with my projects  which use flutter 3.7.
flutter_riverpod blocked to version 2.3.7
Thank you

Perfect. Thanks you gentlemen


Self-driving example

The self driving example (applications/self_driving/visualize_attention.ipynb) throws an exception to me on the visualization code block:
from vis.visualization import visualize_saliency, overlay

titles = ['right steering', 'left steering', 'maintain steering']
modifiers = [None, 'negate', 'small_values']
for i, modifier in enumerate(modifiers):
    heatmap = visualize_saliency(model, layer_idx=-1, filter_indices=0,
                                 seed_input=bgr_img, grad_modifier=modifier)
    plt.figure()
    plt.title(titles[i])
    # Overlay is used to alpha blend heatmap onto img.
    plt.imshow(overlay(img, heatmap, alpha=0.7))

Gives:
ValueError                                Traceback (most recent call last)
<ipython-input-2-56117829ec05> in <module>
      9     plt.title(titles[i])
     10     # Overlay is used to alpha blend heatmap onto img.
---> 11     plt.imshow(overlay(img, heatmap, alpha=0.7))

/anaconda3/envs/mypython3/lib/python3.6/site-packages/keras_vis-0.4.1-py3.6.egg/vis/visualization/__init__.py in overlay(array1, array2, alpha)
     46         raise ValueError("`alpha` needs to be between [0, 1]")
     47     if array1.shape != array2.shape:
---> 48         raise ValueError('`array1` and `array2` must have the same shapes')
     49
     50     return (array1 * alpha + array2 * (1. - alpha)).astype(array1.dtype)
ValueError: `array1` and `array2` must have the same shapes

As far as I can tell, the image loaded is not (FRAME_W, FRAME_H) but rather (FRAME_W, FRAME_H, 3) and the heatmap is (FRAME_W, FRAME_H) hence the error on the overlay. When loading the data in the first code block of the notebook, I don't see how the
img = utils.load_img('images/left.png', target_size=(FRAME_H, FRAME_W))

would make sense because the image has colors.
Repro
I just installed keras-vis by building the repo with
python setup.py install

and my tensorflow version is 1.13
Thanks for any help!

Thank you for your detail report!
We are going to fix this problem.


[REQ] Optimize thread & reply depiction

Describe the problem that needs solving
See explanation image
Describe the solution you'd like
See explanation image

This is a limitation that I'm not sure how to address unfortunately. For the API being used by groups/feeds, Twitter sends back no information on conversations or threads, and only sends back tweets from users that are requested in the query (i.e. your subscriptions). If a thread contains tweets from an account you're not subscribed to, or that account isn't in the current group, those tweets aren't returned.
However, Fritter does try its best with the tweets it is sent back - it will try to build a thread, even if it's only a partial one, but I'm not too sure how to load in any missing tweets (or even to know what those missing tweets are, without making O(n) API calls)

Closing as the feed has now been removed, due to Twitter blocking access permanently. Please see https://github.com/jonjomckay/fritter/issues/668#issuecomment-1528784190


deferredImports as a trace option

deferredImports should always be populated by default in static builds. When doing a static bundle, we also should normalize and recanonicalize the deferred imports on concatenation to work in the target environment.
Eg System.import('jquery', __moduleName) should become System.import('path/to/jquery/jquery.js') in the static bundle as __moduleName is no longer applicable.

I am using builder.compile to produce static preprocessed JS files for production. It seems like since, __moduleName is not declared, that these deferred imports are failing at runtime.
Do you have any workarounds or thoughts? This seems to be a critical hold up to my use-case.
I'd be willing to put in some effort if you would accept it and point me in the right direction.

@joeljeske __moduleName needs to be supported by the compiler you are using. Transpilation for __moduleName is provided in the latest Babel and TypeScript transformers though, so it may be worth checking what exact transpiler version you're on here.

@guybedford, My setup is using Babel, and it does appear that transpilation is happening correctly. Note that the replacement works fine when transpiled JIT in-browser, but it fails to replace __moduleName when run through builder.compile() in node.
I currently have install v0.0.16 of systemjs-plugin-babel and v6.17.0 of babel-core is installed.

Hmmm, it doesn't look like __moduleName is a result of the transpiler. In the browser, __moduleName is a result of this line in systemjs.
The systemjs builder does not yet appear to support it. Thoughts?


Running docker-compose throws error "docker.errors.InvalidArgument: "host" network_mode is incompatible with port_bindings

Issue Description:
Running skydive using docker-compose method throws error "docker.errors.InvalidArgument: "host" network_mode is incompatible with port_bindings"
Env:
-Tested on Linux Mint 20.2
cat /etc/*release
DISTRIB_ID=LinuxMint
DISTRIB_RELEASE=20.2
DISTRIB_CODENAME=uma
DISTRIB_DESCRIPTION="Linux Mint 20.2 Uma"
NAME="Linux Mint"
VERSION="20.2 (Uma)"
ID=linuxmint
ID_LIKE=ubuntu
PRETTY_NAME="Linux Mint 20.2"
VERSION_ID="20.2"
HOME_URL="https://www.linuxmint.com/"
SUPPORT_URL="https://forums.linuxmint.com/"
BUG_REPORT_URL="http://linuxmint-troubleshooting-guide.readthedocs.io/en/latest/"
PRIVACY_POLICY_URL="https://www.linuxmint.com/"
VERSION_CODENAME=uma
UBUNTU_CODENAME=focal

-Docker and docker compose version:
docker --version
Docker version 20.10.8, build 3967b7d

docker-compose --version
docker-compose version 1.29.2, build 5becea4c

Steps to replicate issue:
-Followed documentation using the docker-compose method
curl -o docker-compose.yml https://raw.githubusercontent.com/skydive-project/skydive/master/contrib/docker/docker-compose.yml

-Running docker-compose throws error "docker.errors.InvalidArgument: "host" network_mode is incompatible with port_bindings"
-Below are logs for reference:
docker-compose up
Creating skydive_elasticsearch_1 ... done
Creating skydive_skydive-analyzer_1 ... done
Creating skydive_skydive-agent_1    ...

ERROR: for skydive_skydive-agent_1  "host" network_mode is incompatible with port_bindings

ERROR: for skydive-agent  "host" network_mode is incompatible with port_bindings
Traceback (most recent call last):
  File "docker-compose", line 3, in <module>
  File "compose/cli/main.py", line 81, in main
  File "compose/cli/main.py", line 203, in perform_command
  File "compose/metrics/decorator.py", line 18, in wrapper
  File "compose/cli/main.py", line 1186, in up
  File "compose/cli/main.py", line 1182, in up
  File "compose/project.py", line 702, in up
  File "compose/parallel.py", line 108, in parallel_execute
  File "compose/parallel.py", line 206, in producer
  File "compose/project.py", line 688, in do
  File "compose/service.py", line 564, in execute_convergence_plan
  File "compose/service.py", line 480, in _execute_convergence_create
  File "compose/parallel.py", line 108, in parallel_execute
  File "compose/parallel.py", line 206, in producer
  File "compose/service.py", line 478, in <lambda>
  File "compose/service.py", line 457, in create_and_start
  File "compose/service.py", line 334, in create_container
  File "compose/service.py", line 941, in _get_container_create_options
  File "compose/service.py", line 1073, in _get_container_host_config
  File "docker/api/container.py", line 598, in create_host_config
  File "docker/types/containers.py", line 339, in __init__
docker.errors.InvalidArgument: "host" network_mode is incompatible with port_bindings
[819582] Failed to execute script docker-compose

-Below is the docker-compose file:
version: '2'
services:
  elasticsearch:
    image: elasticsearch:5
    ports:
      - "19200:9200"
      - "19300:9300"
    environment:
      - "discovery.type=single-node"
    networks:
      - skynet

  skydive-analyzer:
    image: skydive/skydive
    ports:
      - "8082:8082"
      - "8082:8082/udp"
    links:
      - elasticsearch
    command: analyzer --listen=<IP_ADDRESS>:8082
    environment:
      - SKYDIVE_STORAGE_ELASTICSEARCH_HOST=elasticsearch:9200
      - SKYDIVE_ANALYZER_STORAGE_BACKEND=elasticsearch
      - SKYDIVE_GRAPH_BACKEND=elasticsearch
      - SKYDIVE_ETCD_LISTEN=<IP_ADDRESS>:12379
    networks:
      - skynet

  skydive-agent:
    image: skydive/skydive
    depends_on:
      - skydive-analyzer
    ports:
      - "8081:8081"
    network_mode: "host"
    pid: "host"
    command: agent --listen=<IP_ADDRESS>:8081
    privileged: true
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
      - /var/run/netns:/host/run
      - /var/run/openvswitch/db.sock:/var/run/openvswitch/db.sock
    environment:
      - SKYDIVE_AGENT_TOPOLOGY_NETNS_RUN_PATH=/host/run
      - SKYDIVE_ANALYZERS=<IP_ADDRESS>:8082

networks:

-From above, it does have "network_mode" as  "host" along with "ports" defined.

@lebauce
-With the below compose (latest fix),  it working. Thanks for fixing the issue.
version: '2'
services:
  elasticsearch:
    image: elasticsearch:5
    ports:
      - "19200:9200"
      - "19300:9300"
    environment:
      - "discovery.type=single-node"
    networks:
      - skynet

  skydive-analyzer:
    image: skydive/skydive
    ports:
      - "8082:8082"
      - "8082:8082/udp"
    links:
      - elasticsearch
    command: analyzer --listen=<IP_ADDRESS>:8082
    environment:
      - SKYDIVE_STORAGE_ELASTICSEARCH_HOST=elasticsearch:9200
      - SKYDIVE_ANALYZER_STORAGE_BACKEND=elasticsearch
      - SKYDIVE_GRAPH_BACKEND=elasticsearch
      - SKYDIVE_ETCD_LISTEN=<IP_ADDRESS>:12379
    networks:
      - skynet

  skydive-agent:
    image: skydive/skydive
    depends_on:
      - skydive-analyzer
    network_mode: "host"
    pid: "host"
    command: agent --listen=<IP_ADDRESS>:8081
    privileged: true
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
      - /var/run/netns:/host/run
      - /var/run/openvswitch/db.sock:/var/run/openvswitch/db.sock
    environment:
      - SKYDIVE_AGENT_TOPOLOGY_NETNS_RUN_PATH=/host/run
      - SKYDIVE_ANALYZERS=<IP_ADDRESS>:8082

networks:
  skynet:


Widget seems stuck

Hi,
First of all, thanks for this great app!
On my android device (4.2.2) with AndStatus v16.0 the widget is sometimes frozen : displays "no data since " and never refreshes anymore. By removing and putting the widget back, it displays "no data yet." forever. Even when opening the app and refreshing the timeline, the widget seems ignoring the update.
Only have a twitter account configured.
Keep up the good work!
Sevan

Hi Sevan,
The widget shows new messages only when these new messages are received in a background, while you are not using AndStatus.
Number of new messages is reset, when you open AndStatus application.

Hi Yvolk,
Thanks for your quick answer!
Yes, that was the case : when I opened the app, the widget was reset and displayed the time since which there was no new messages.
But when syncing in background, the last sync time was updated on the widget.
Now the time is frozen, or (when I remove the widget and set it up again) the 'no data yet' message is displayed forever.
Maybe it is linked to the syncing mechanism of Android itself : I tried to restart my phone and the widget displays "Nothing new since: " which is the expected behaviour.
But at the end of the day, widget was stuck again.
Can it be linked to a limit of 'sync request' on Twitter ? Does third party app like AndStatus have a limited request number via the tiwtter API ?
Thanks,
Sevan

Hi Sevan,
I think automatic syncing is turned off in Androis "Settings" application: for all accounts or only this AndStatus one.
Please check.
See below an example Android screenshot where sync for some accounts is "on", and is "off" for others...

OK will check.
Thanks again !


Error 429

Running into an issue when executing jekyll serve:
Jekyll console response:
Incremental build: disabled. Enable with --incremental
      Generating...
  Liquid Exception: The Strapi server sent a error with the following status: 429. Please make sure it is correctly running. in /_layouts/default.html
jekyll 3.7.3 | Error:  The Strapi server sent a error with the following status: 429. Please make sure it is correctly running.

 I have the articles referenced in the home.html and in an article.html file and that's it.

Hi
Quick question: did you check if your strapi server is serving the data when using a browser?

Thanks for replying! I did. I go to http://localhost:1337/articles?_limit=10000 and the JSON is there.

Friends! Romans! Countrypeople! I found the solution by just changing the request.json config file in plugins/user-permissions/config.

Thx for the update

What was the update you made to the request.json?


reference code for the dataset generation method

Hi,  does the reference code of dataset generation method release?

Hi, thanks for your interests to nn-Meter! We have the plan to release the code of data generation. Due to other features with higher priority, the dataset generation code is planed to be released in about May, 2022.

Hi, thanks for your interests to nn-Meter! We have the plan to release the code of data generation. Due to other features with higher priority, the dataset generation code is planed to be released in about May, 2022.

Hi, I am customizing a new predictor to try nn-Meter out. To make things easier, I only changed to another Cortex cpu and still using the benchmark_model_cpu_v2.1 profiler you provided. Now I am at the final steps of Build Kernel Latency Predictor ,  and I realize that I won't be able test the accuray of the predictor. So I am wondering how could I create my own benchmark datasets? Is it the dataset generation code you mentioned above? @JiahangXu

That's right. To test the model level prediction accuracy, you should generate some sample based on different network architecture. We plan to release the code of data generation in about May. The idea of dataset generation is change configs, such as the output channel of every building block in Mobilenet, and the kernel size for dwconv operation, based on one fixed network architecture. After generating models in .pb format, the nn-meter ir graph could be generated by command nn-meter get_ir --tensorflow <pb-file> [--output <output-name>]. And the golden standard of latency could be obtained by profiling. If you are in urgent, you can follow the mentioned step to generation benchmark dataset. I'm sorry for the inconvenience.

That's right. To test the model level prediction accuracy, you should generate some sample based on different network architecture. We plan to release the code of data generation in about May. The idea of dataset generation is change configs, such as the output channel of every building block in Mobilenet, and the kernel size for dwconv operation, based on one fixed network architecture. After generating models in .pb format, the nn-meter ir graph could be generated by command nn-meter get_ir --tensorflow <pb-file> [--output <output-name>]. And the golden standard of latency could be obtained by profiling. If you are in urgent, you can follow the mentioned step to generation benchmark dataset. I'm sorry for the inconvenience.

Hi there. I tried to profile models in pb_models.zip with benchmark_model_cpu_v2.1 on my CortexA73 device, but I can't convert the pb model to  tflite format. The code I am using for example are:
import tensorflow as tf tf_model_path = "..../mobilenetv2_0" tflite_model_path = ".../mobilenetv2_0.tflite" converter = tf.lite.TFLiteConverter.from_saved_model(tf_model_path) tf_lite_model = converter.convert() with open(tflite_path, 'wb') as f:     f.write(tflite_model_path)
and I always get a error as RuntimeError: MetaGraphDef associated with tags {'serve'} could not be found in SavedModel. To inspect available tag-sets in the SavedModel, please use the SavedModel CLI: saved_model_cli
available_tags: [set()] . I also tried convert a onnx model to pb then to tflite model, and It doesn't raise error any more, but the nchw to nhwc input format conversion leads to many Pad and Transpose ops in the output model, which significantly affects the latency profiled.
So while you are working hard on the dataset generation code, could you please open source the tflite models as you did with pb_models.zip and onnx_models.zip in advance? Or can you provide a practicable method for converting to tflite format with your already open sourced pb/onnx model?
Many thanks. @JiahangXu

Did the dataset generation code released? I didn't find it.


Backup and Recovery Strategy

Description:
• Establishment of regular backup procedures for the server and database.
• Creation of a disaster recovery plan to minimize downtime and data loss in case of a server failure.
Definition of done:
Backup systems tested and confirmed, ensuring data integrity and system resilience.

Good issue with a clear and well-defined completion criteria.