Store incoming notifications in new DB entity with no extra logic

Summary
When notifications are received ideally no extra logic is done other than storing them in the database after the authentication methods have been verified. With this PR we're saving the incoming notifications AS IS in a new database entity. On cron job run they are converted and stored as a regular notification to be processed.
Tested scenarios
After the authentication is valid incoming notifications are received successfully regardless of content, and stored in a new table s_plugin_adyen_text_notification.
On cron job run the text notifications stored are fetched, converted into regular notifications in s_plugin_adyen_order_notification and processed.
Fixed issue: #81

@acampos1916
To be verified with pull request: https://github.com/Adyen/adyen-shopware5/pull/115

@acampos1916
To be verified with pull request: https://github.com/Adyen/adyen-shopware5/pull/115

@bortefi I see you used NotificationReceiver from the library but this was included in version 7. The plugin uses ^6.1 so I'm replacing the call with the function logic until this is outsourced.

@bortefi I see you used NotificationReceiver from the library but this was included in version 7. The plugin uses ^6.1 so I'm replacing the call with the function logic until this is outsourced.


Final "DemoAndScripts" folder did not make the 2015 Q4 Release

Final "DemoAndScripts" folder was included in 2015 Q4 Patch.


How to support partial-upload

hi:
I looked at the upload logic in the source code and found that the content -range field parameter is not used. At the same time,  If you do not use offset to modify some bytes, only use copy to overwrite all file streams, It can not meet some business scenarios.
I have tried many times and found that if I modify some bytes of a large file, the put-handle need to update the file completely, which is inefficient.

so  i want to kown how to support partial upload.

Thank U.

You are correct, this is not supported. I guess that it would take some effort to implement this properly and I need a client that supports it - and a way to communicate to the client that partial uploads are supported.

Duplicate of #8


#216 Allow ContentType queries to be performed on non-default databases.

Thanks for the wonderful work, this seems like a ready to merge feature!
I wonder, instead or passing using=DEFAULT_DB_ALIAS to all model methods, would it work to read sefl._state.db or is the ContentType located in a different DB then the models that derive from it?

Thanks for the feedback! I took your suggestion and switched to using self._state.db in the model methods. It keeps the interface cleaner and I think is more consistent with Django's behavior, so it seems like a better way to handle this.
(I didn't actually know about ModelState before your comment, which is why I wasn't using it before :) )
The one exception is the save method, and by extension the pre_save_polymorphic method. save checks the using kwarg, then self._state.db, then falls back on DEFAULT_DB_ALIAS; pre_save_polymorphic simply uses the kwarg value. Since self._state.db won't be populated for new instances and callers may also override the database when calling save, I thought it was better to use the argument. However, I can certainly change this behavior if you'd prefer.
I also fixed a couple spots in the query_translate functions where I wasn't passing the using value correctly before. instance_of filters should work correctly now.
Finally, I've also added a couple unit tests for the new functionality, but not many. If I need to add more, please let me know.
Thanks!

Wonderful, thanks for updating this swiftly!


Include Files.DataLake in ApiCompat.csproj once it is GA'ed

https://dev.azure.com/azure-sdk/internal/_wiki/wikis/internal.wiki/126/API-Compatibility-Verification-.NET
Steps to include Files.DataLake:
Update eng/ApiCompat/ApiCompat.csproj to include package references for the Files.DataLake library.
Update eng/Packages.Data.props to include the current versions of the packages.
Remove EnableApiCompat param (or set to true) from Files.DataLake csproj file.

ApiCompat.csproj has changed since this issue was opened.
https://github.com/Azure/azure-sdk-for-net/blob/master/eng/Packages.Data.props#L27
EnableApiCompat is no longer present in DataLake.csproj


Repeatable Table Headers [More Flexible Tables Pt.5a]

Allows specifying a grid.header and table.header to have some rows repeat across a grid's or table's pages.
~~NOTE: This PR depends on #3501, so the PR diff is larger than it really is; as such, here is the link to the real diff: https://github.com/PgBiel/typst/compare/rowspans...PgBiel:typst:repeatable-headers~~ (EDIT: PR rebased!)
First part of the fifth task in #3001. Closes #400 (as the initially desired feature set is available), although more header features are intended to be added over time.
For now, a header may only start at the top of the table, and end at its last page.
User-facing API

You may now use table.header and grid.header to place a repeatable header in your grid or table. It will repeat across pages.

You can also specify table.header(repeat: false, ...) to not repeat it, though that's generally not very useful (other than for organizational purposes), so the default is repeat: true.
When row gutter is enabled, the row gutter immediately below the header is repeated as well. Looks better that way.

#set page(width: auto, height: 15em)
#table(
  columns: 5,
  align: center + horizon,
  table.header(
    table.cell(colspan: 5)[*Cool Zone*],
    table.cell(stroke: red)[*Name*], table.cell(stroke: aqua)[*Number*], [*Data 1*], [*Data 2*], [*Etc*],
    table.hline(start: 2, end: 3, stroke: yellow)
  ),
  ..range(0, 15).map(i => ([John \##i], table.cell(stroke: green)[123], table.cell(stroke: blue)[456], [789], [?], table.hline(start: 4, end: 5, stroke: red))).flatten()
)

// With gutter
#set page(width: auto, height: 15em)
#table(
  columns: 5,
  align: center + horizon,
  gutter: 3pt,
  table.header(
    table.cell(colspan: 5)[*Cool Zone*],
    table.cell(stroke: red)[*Name*], table.cell(stroke: aqua)[*Number*], [*Data 1*], [*Data 2*], [*Etc*],
    table.hline(start: 2, end: 3, stroke: yellow),
  ),
  ..range(0, 15).map(i => ([John \##i], table.cell(stroke: green)[123], table.cell(stroke: blue)[456], [789], [?], table.hline(start: 4, end: 5, stroke: red))).flatten()
)

Without gutter:

With gutter:

Implementation details
The implementation is actually rather simple (compared to other PRs, such as rowspans - that one was very complex). Here are the most important tricks I used for layout:

Header information is kept in a (for now, minimal) Header struct in CellGrid. It currently only contains where the header stops, since the header always starts at y == 0.
At the end of finish_region, we call layout_header, which will layout, for the next region, each individual header row as an unbreakable row group, and thus calculate the header height for the current region.
layout_header will use simulate_header (which just calls simulate_unbreakable_row_group from the rowspans PR) to calculate the header height and skip to the first fitting region.
To prevent header orphaning, we skip regions which only contain the header but no more rows (at the top of finish_region).
(Core detail) Unbreakable row groups and fixed-size rows may skip regions until they fit, but they stop if self.regions.in_last() is true, currently. In this PR, however, I created a new in_last_with_offset function. It's very similar to the former, but instead of checking if we're in the regions.last region and all the full height is remaining, we check if full height - header height is remaining, since skipping a region will always add a header to the top. So, if we're at the last region and there's just the header above us, we stop skipping.
(Core detail) Regarding auto rows, the changes were in two places.

In prepare_auto_row_cell_measurement, where we prepare the information needed to construct the pod, we now use self.regions.map to modify the backlog and the last region by subtracting the current header height from both. This makes sure cells in breakable auto rows won't overlap with the header.

Alternatively, we could have changed Regions::next to automatically subtract an automatically-calculated header height from the new region size and not change the value of full, which is probably more technically appropriate, but I didn't take this approach not only to keep the implementation simple, but also because full is already reduced when we're effectively laying out the rowspan, so it wouldn't make much of a difference in practice, other than through possibly very unusual setups. We can always change this in a future update as users give their feedback.

In the rowspan simulation procedures, I basically replicated all of the behavior described above, subtracting header height from each new simulated region, and re-simulating the header when we would otherwise "place" it.

And that's it!
Other details

Regarding the API: I created the Grid/TableHeader structs; changed Grid/TableChild to accept both headers and Grid/TableItem (the old children); headers can contain items too (but not other headers, of course - there are helpful errors for that). In CellGrid::resolve, there are now two for loops - one for children and one for items inside the children (if the child is a header, then one child iteration will correspond to N item iterations (inside the header); if the child is a single item, then there's only a single item iteration, and everything behaves as usual).

We perform some extra logic here to ensure the header starts in the first row, and also to ensure all rowspans are fully contained within the header, causing it to expand.
If the header is too large, we don't care, it will just look bad. Blame the user here.
Added some "FIXME" comments for when we update headers to be able to appear in other places than the first row, but for now they aren't of concern.

Regarding lines: Header lines have priority when repeated, in general, but they lose against explicit lines unless they are explicit lines themselves (basically works like top border stroke).

I've added a fix for a small bug I found while, well, pondering about things. :P
Turns out lines above empty auto rows were being ignored since the auto rows were removed. Now they are still considered, but have less priority than lines above whatever is below.

Needs merge/rebase for status checks to be okay again.

 There could perhaps be more, but in principle the most relevant ones should be gone. We can probably figure the rest out during testing.

Ready. :+1:

Great, thank you!


Partial views topic update

Fixes #8188
Fixes https://github.com/aspnet/Docs/issues/6573
Internal Review Topic

Expanding topic+sample to include Razor Pages calling partial views.
Went with one sample, which is currently 2.1. The RP example exactly mirrors the MVC example. This topic is already listed in the table on #5495 that we'll copy and use to track 2.2 sample updates. I've added a note to the table to surface the changes that will be required for 2.2.
Engineering, plz head-check me on the following remark that I make on Line 157, which offers guidance for streaming the partial vs. not streaming the partial ...

Since RenderPartialAsync streams rendered content, it provides better performance in some scenarios. In performance-critical situations, benchmark the page using both approaches and use the approach that generates a faster response.

... Is that a fair suggestion, and can we can flesh out "some scenarios"?
Thanks to @mikebrind :rocket: for helping with the search locations/order.

Thanks @pranavkm ... Is this remark ok? ...

Since RenderPartialAsync streams rendered content, it provides better performance in some scenarios. In performance-critical situations, benchmark the page using both approaches and use the approach that generates a faster response.

Is there anything else that can be said about the "some scenarios" part? Can I state one (or a few) "for examples" there?

@scottaddie Still guessing on /Pages/Shared, since that isn't in the referenced code.
... and one more commit coming on that list. Stand-by.

@guardrex Let's have @pranavkm review the search path list for accuracy when you're done.

I don't have knowledge to resolve ...
options.AreaViewLocationFormats.Add("/Views/Shared/{0}" + RazorViewEngine.ViewExtension);

vs.
options.ViewLocationFormats.Add("/Views/Shared/{0}" + RazorViewEngine.ViewExtension);

... since they both have the same path.
I may have been headed in the right direction with the first approach that splits the Areas out. Not sure what's best here.
So ..... we have this, which is wrong for MVC (/Views/Shared repeated from AreaViewLocationFormats and ViewLocationFormats) ....
::: moniker range=">= aspnetcore-2.1"

**Razor Pages**

1. Currently executing page's folder
1. Directory graph above the page's folder
1. `/Shared`
1. `/Pages/Shared`
1. `/Views/Shared`

**MVC**

::: moniker-end

::: moniker range=">= aspnetcore-2.0"

1. Currently executing view's folder
1. `/Views/Shared`
1. `/Areas/<Area-Name>/Views/<Controller-Name>`
1. `/Areas/<Area-Name>/Views/Shared`
1. `/Views/Shared`
1. `/Pages/Shared`

::: moniker-end

::: moniker range="< aspnetcore-2.0"

1. Currently executing view's folder
1. `/Views/Shared`
1. `/Areas/<Area-Name>/Views/<Controller-Name>`
1. `/Areas/<Area-Name>/Views/Shared`
1. `/Views/Shared`

::: moniker-end

... and my original approach was (and I've added "additional" to the Areas locations searched) ...
::: moniker range=">= aspnetcore-2.1"

**Razor Pages**

1. Currently executing page's folder
1. Directory graph above the page's folder
1. `/Shared`
1. `/Pages/Shared`
1. `/Views/Shared`

**MVC**

::: moniker-end

::: moniker range=">= aspnetcore-2.0"

1. Currently executing view's folder
1. `/Views/Shared`
1. `/Pages/Shared`

::: moniker-end

::: moniker range="< aspnetcore-2.0"

1. Currently executing view's folder
1. `/Views/Shared`

::: moniker-end

If the partial view is called from an Area view, the following additional locations are searched:

1. `/Areas/<Area-Name>/Views/<Controller-Name>`
1. `/Areas/<Area-Name>/Views/Shared`
1. `/Views/Shared`

@pranavkm What priority is given to Area search paths in relation to the standard search paths? We're trying to determine the correct search order.

Thanks @pranavkm
Do you have anything else on this one @scottaddie?


add withdraw to limitedlives

What and How?
i want to withdraw lives to trade/sell
Why?
i did above these mean same thing to me
Are there alternatives?
add withdrawing alternitave enough
Checks

[X] I have used the search at least once to check if my idea has already been suggested and perhaps already implemented.

Anything else
pls add withdraw

Snapshot build: https://github.com/srnyx/limited-lives/actions/runs/7152715008

https://github.com/srnyx/limited-lives/commit/0224c89ff51cc0a7c33556a8ceda5ca7bc56a3b9


[BUG] Neovim Freezes

Is there an existing issue for this?

[ ] I have searched the existing issues

Current Behavior
When I am editing a dart file , press Enter i.e (  )  key my whole neovim gets halt for a second , this does not occur every time I press enter but most of the time . This is issue is only persist in the dartls
https://github.com/akinsho/flutter-tools.nvim/assets/90999700/410f9ff5-10b2-4a96-b8c3-84f1aeb8f589
Also : After the neovim freezes and I can continuously press enter without any issue.
Expected Behavior
When I should press the enter key the neovim should never get halt , with .dart files
https://github.com/akinsho/flutter-tools.nvim/assets/90999700/973a497a-d880-4ce4-8646-83c31e775885
In the above video enter key is working fine without any error , To be precise I am editing a pubspec.lock file
Steps To Reproduce
issue_log.txt
Attaching some logs that might make the issue more  clearer
Environment
- OS:Manjaro Linux x86_64
- Flutter version: 3.10.3
- Is flutter in $PATH: Yes
- neovim version: 0.9.0

Anything else?

LSP info SS
#248
This timeout issue looks similar to mine but I tried everything still nothing worked .
"server_request: callback result"	{  result = vim.NIL,  status = true}
Saw this log in  my log history .

I am having the same issue. I have tried a bare bones config and still get the error. Also, this only happens with dartls

I am having the same issue. I have tried a bare bones config and still get the error. Also, this only happens with dartls

@nav-28 can you please confirm what a barebones config means in this case. Are you still using a configuration framework? can you please include precisely what minimal init.lua setup you are using that reliably reproduces this issue.

I am having the same issue. I have tried a bare bones config and still get the error. Also, this only happens with dartls

@nav-28 can you please confirm what a barebones config means in this case. Are you still using a configuration framework? can you please include precisely what minimal init.lua setup you are using that reliably reproduces this issue.

Oh I was using LazyVim. Although I have not been able to recreate it. I redid my config and removed unused plugins and something fixed it. Sorry, I couldn't catch what was causing the issue.

Ok closing this out since it's reproducible with a minimal configuration

Hi,
I am also having this same exact issue. But I was able to isolate it and make it work. The freeze happens if you have nvim-treesitter configured to handle indentation. I'm guessing there is a conflict between nvim-treesitter and flutter-tools trying to handle what happens when the ENTER key is pressed.
Adding the following in my nvim-treesitter configuration fixed the issue:
indent = {
	enable = true,

	-- NOTE: enabling indentation significantly slows down editing in Dart files
	disable = {'dart'}
}

Hope that helps.


Revisions to lambda expressions topic.

Revisions to lambda expressions topic
Summary
Extensively revised with new examples and a section on tuples and lambda expressions.
Suggested Reviewers
@BillWagner @stevehoag @mairaw

There are some build errors. It would be good to fix those first, otherwise we can't even see it on staging.

@mairaw I think I've fixed all the build errors.  A new build should run shortly.

@BillWagner I've addressed all of your comments and will update the topic.

@rpetrusha LGTM.  :shipit:


Tesitng a theory with a badge change

This is an experiment to test a theory about why the builds aren't running

Bingo!!!


Manager-specific dashboard tiles

Is there a way to add all of these without needing to filter on the report individually and adding? If not, I tried this filter then pin method and I can't tell which filter is being applied, so is there a way to include that in the title?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c25ad9a8-50b9-7f83-4e10-ebbbff013d6b
Version Independent ID: 0584427f-6438-277b-4a0c-5d51f4694f63
Content: Customer Profitability sample for Power BI: Take a tour - Power BI
Content Source: powerbi-docs/sample-customer-profitability.md
Service: powerbi
Sub-service: powerbi-desktop
GitHub Login: @maggiesMSFT
Microsoft Alias: maggies

Thanks for your comment, @lorenamschafer . This issue has been assigned to the doc author for review.


Convergence criteria

Adressing #153 #154
@rgbmrc you ok with co-authoring this? wanted to indicate that this is your suggestion =)

@rgbmrc you ok with co-authoring this? wanted to indicate that this is your suggestion =)

@Jakob-Unfried sure, I am happy with it, thanks! If there is some other way you'd like me to contribute the PR please let me know :)

[ ] Run notebooks and examples to double check


[NO MERGE] Add support for required values to RoutePattern

This change adds first class support for what MVC does to substitute route values into templates. Rather than munging strings, I chose to introduce required values as a fundamental concept.
The idea is that a conventional-route-style template could we written once, and then expanded for every action and controller that exists. Making this first class in routing moves the complexity into the right place, and will reduce the number of endpoints produced for a conventionally routed application significantly.
Still left to do here is to add support to DfaMatcher to process the required values. Then we should probably obsolete IRouteValuesAddressMetadata since it's now first class.

@JamesNK updated - if you're happy with the state of things, feel free to add the DFA matcher part.

Looks good to me.

Then we should probably obsolete IRouteValuesAddressMetadata since it's now first class.

IRouteValuesAddressMetadata has route name. It would either be new metadata or on RoutePattern as well.

IRouteValuesAddressMetadata has route name. It would either be new metadata or on RoutePattern as well

yeah exactly 😁

Did you plan for me to merge this into master or are you going to build on top of it?


Prepare 3.53.0

Critical Changes
Changes
Issues Closed

Give me a minute to try and fix snowfakery.readthedocs.io so I can link to it please.


Upgrade to Keycloak 26 base theme for new authChecker.js

authChecker.js was recently updated in Keycloak 26.
Keycloakify is currently based on 25.0.4 base theme. This project needs updating to the latest base theme to pick up these improvements.

Yes,
Related to https://github.com/keycloakify/keycloakify/discussions/729


fix(icon): fix icon path

The latest build is broken due to the icon image path being relative and wrong. This reverts the path resolution to a previous version that fixes the issue. tested on macOS 12.

I have postponed version 1.3.0 until multiple bugs are fixed. Sorry.


 In case of Cassandra, the servers do start, but the query server is unable to find cassandra:
server_1   | 2016-05-28 17:49:19.815 ERROR 7 --- [nio-9411-exec-7] o.a.c.c.C.[.[.[/].[dispatcherServlet]    : Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception [Request processing failed; nested exception is com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra:9042 (com.datastax.driver.core.exceptions.TransportException: [null] Cannot connect))] with root cause
server_1   |
server_1   | com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra:9042 (com.datastax.driver.core.exceptions.TransportException: [null] Cannot connect))

Was able to fix the cassandra case by using storage as the host name. Perhaps MacOS native Docker does not understand container_name: cassandra
$ docker exec -it 81d12b4177cd /bin/sh
/zipkin # nslookup cassandra
nslookup: can't resolve '(null)': Name does not resolve

nslookup: can't resolve 'cassandra': Name does not resolve

/zipkin # nslookup storage
nslookup: can't resolve '(null)': Name does not resolve

Name:      storage
Address 1: <IP_ADDRESS> 52e205529e58_52e205529e58_52e205529e58_cassandra.dockerzipkinjava_default

Fix:
-      - CASSANDRA_CONTACT_POINTS=cassandra
+      - CASSANDRA_CONTACT_POINTS=storage

redirected to here https://github.com/openzipkin/docker-zipkin/issues/108


Add React Native support

About
React native support
Todo

[x] Create websocket connection to electron app
[x] Use messaging to communicate version (native + browser)

Thanks for the review @kadikraman 🙏


Add editor for sector range fan

Test case:
Plot a circular range fan.
Edit the range fan. The test is a success if the editor allows the dragging of range fans,, adding , and removal of concentric circles.

Reintegrate

merged into the dev branch. Closing this issue.


Altering plan and service for conflict Test

Instead of editing the parameter field, the plan and service id will be exchanged with others from the catalog to test a conflict case when attempting to call PUT binding.

But you are aware, that you want to merge into master?

Yes, because this is a hot fix and not a new feature.


Mousewheel click opens new tab at selected path

Resolved / Related Issues
Items resolved / related issues by this PR.

Closes #3667

Details of Changes
Add details of changes here.

Added method to capture mouse clicks. Middle clicks are filtered and a new tab opened.

Validation
How did you test these changes?

[X ] Built and ran the app
[X ] Tested the changes for accessibility

Screenshots (optional)
Add screenshots here.

@Raithlin do you know why sometimes it opens the same folder in both new tab and actual tab? I can't replicate consistently, but it happens some times in my tests without any apparently reason.

I had that happen once, thought I had clicked on something else. I can take a look - most likely the click method is being called as well. I can't check the mouse status in that method either, so it makes it a little more difficult to prevent. Any ideas?

I added logging (temporarily) to see which methods were being called. Both were.
I changed the process to use a private pointerroutereventargs to pass to the tapped event as per https://stackoverflow.com/questions/44111224/pointerpressed-vs-tapped#44125921. No click through happening any more, and the middle click still works.


More mnemonics for icarus/random wallets

Issue Number

#1803
Overview

[x] I have enabled more mnemonics lengths for random/icarus wallets
[x] I have updated swagger and Malformed in core unit tests
[x] I have updated byron integration scenarios

Comments

bors try

bors r+


fix(version): update fabric8-stack-analysis-ui to 0.1.31

There were the following issues with your Pull Request

Commit: ee3f576509143d53eb22071a6fdb61aee18a3346
Your subject line is longer than 50 characters

Guidelines are available at https://github.com/fabric8io/fabric8-ui

This message was auto-generated by https://gitcop.com


how pull new locale? UA locale

I wrote ua locale but lazy setup git for create push request, from UI can't do it, may somebody push this file
link for locale

Duplicat of https://github.com/moment/moment/issues/4734

closed as duplicate


Deduplication results vary depending on whether Spark is used or not.

Hi ChenghaoMou
I have recently been using your program to deduplicate a huge amount of data. However, in certain situations, there is a significant difference between deduplication using spark and without spark.
I deduplicated 29GB of Python code data, and when minhash_spark.py was used, 95% remained and was almost not erased, but when minhash.py was used, 5% remained.
To analyze the problem, I randomly output a deduplicated cluster, and minhash.py did not produce incorrect results.
Therefore, it seems to be a problem occurring in minhash_spark.py, but seeing as it worked well even with data exceeding 1TB, it seems like the problem is occurring for a specific reason regardless of the data size.
Algorithmically, the spark process that obtains the min index through map reduce in connected components and minhash.py that obtains the min index through union find also seem to have no problem.
What is the difference? Are there any issues you are aware of?

@cjmp1 Thank you so much for opening this issue.
It does seem off based on your description. However, to effectively debug this discrepancy, could you provide 1) the commands you have used, and 2) some data so I can reproduce the issue?
The clustering method is mostly likely not the issue. You can see in the benchmark section in the README file, they have minor differences, generally from different hash signatures (not deterministic) and therefore outputs as well.

Thank you for your reply. In the case of data, this data cannot be shared under license.
This is normal python code, nothing special.
First, I'm looking for open datasets that produce similar results.
Additionally, below is the command bash file I used for deduplication.
spark-submit
--master spark://${master_ip}:7077
--conf spark.driver.host=${master_ip}
--conf 'spark.hadoop.fs.s3a.impl=org.apache.hadoop.fs.s3a.S3AFileSystem'
--conf 'spark.hadoop.fs.s3a.endpoint={our s3 endpoint}
--conf 'spark.hadoop.fs.s3a.aws.credentials.provider=org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider'
--conf 'spark.hadoop.fs.s3a.connection.maximum=5000'
--conf 'spark.driver.extraClassPath=/spark/jars/'
--conf 'spark.executor.extraClassPath=/spark/jars/'
--driver-memory 70g --executor-memory 16g --executor-cores 3 --total-executor-cores 2200
minhash_spark.py --input $dataset --output /dedup/test/$dataset/2 --column content

@ChenghaoMou Hi
It seems that a problem has been found in the minhash.py algorithm.
uf.union(x, idx) method is executed on the index values on the cluster.
In this case, there is a possibility that one connected component may be separated into components with two different minimum parents. If the union operation is not executed again between the two components
In the case of minhash_spark.py, in this case, it is classified as a component with one parent.
Of course, this does not prove that more deduplication occurs in minhash.py.
In fact, as the number of components increases, shouldn't the min index itself, which remains due to deduplication, increase?

Thanks for providing the info.
If you check out the union code, you can see that we are connecting parent index when calling union:
    def union(self, x, y):
        px = self.find(x)
        py = self.find(y)

        # If both elements are already in the same set, do nothing
        # The line in original UnionFind `self.parent[px] = self.parent[py] = min(px, py)` is redundant when px == py
        if px == py:
            return

        if self.rank[px] == self.rank[py]:
            # If ranks are equal, choose one as the new root and increment its rank
            # with few duplicates this is likely to be the most common case
            self.parent[py] = px
            self.rank[px] += 1
        # otherwise, assume that leftside is more likely to be higher rank
        # Attach the smaller rank tree under the root of the larger rank tree
        elif self.rank[px] > self.rank[py]:
            self.parent[py] = px
        else:
            self.parent[px] = py

So regardless of the order, two parts will be connected as long as there are any edges that link them together.
If you are seeing issues with minhash.py's results, can I ask if you made any changes to the script?
Another you can try is to run this notebook with some of your data with spark installed as standalone:  notebooks/quick_debug.ipynb (I added this in the latest commit). This should give you almost the same results.

Oh no, it seems to me that we applied the previous version of union_find when running minhash.py. It seems to have been used interchangeably with files from the old bigcode-dataset repository. I will run it after editing and let you know. Thank you.


Encode url before create tinyurl.

When the url have # the tinyurl is only the host.
Example:
http://test-server:8080/#/test/Z4zm4OuFTqiE5Fw46m4fdA
The tinyurl decoded will be :  http://test-server:8080
With the encoded url all url works.

Thanks for the great improvement!


Update Israel's prefixes of mobile phone numbers

for more details:
https://en.wikipedia.org/wiki/Telephone_numbers_in_Israel

Thanks :smile:


Methodologies for Alpha Finance, Biswap, Synapse and cBridge

In the subgraph subfolder there is a folder Read Me Files (new) that contains additional read me for subgraphs not created. I could create their own folder if you prefer and resubmit pull request.

Will do thank you


Added module.exports

Fixed issue with Webpack and other build tools that use require or import.  The datetimepicker needs to be exported for these tools to work.  The code branch I modified should only be hit if the user is using a build tool like Webpack.
Fix directly taken from this issue: (thanks @melanke)
https://github.com/Eonasdan/bootstrap-datetimepicker/issues/1532
Should also fix: https://github.com/Eonasdan/bootstrap-datetimepicker/issues/1319

Wonderful, thank you very much!  When are you planning on releasing the next update?


balena: fix tty console hanging in some cases

https://github.com/resin-os/balena/pull/101
Change-type: patch
Signed-off-by: Petros Angelatos<EMAIL_ADDRESS>

@resin-jenkins retest this please

@resin-jenkins retest this please


Implementing FMFilterable

Hi,
I really appreciate the tremendous work you did. I have couple of extra filters to be added on the slider. However I'm not sure how to add them using FMFilterable. I tried several things but truly speaking couldn't manage smoothly.
If you can support with an example, I really appreciate for that.
Thank you,
Baris

Thanks for those kind words.
Can you post your current configuration here? Then I can give you some suggestion.

Hi again,
Into FMFilter.swift file, I've added my new filter, where applicable.
Then, in Const.swift file, I've added new filter name into kDefaultAvailableFilters.
Now at the end of the slide, I can see the new filter name, however it does not have any functionality, and I cannot find where to add the filter code.

@barisnurlu
Can you post your configuration? It's easy for me to understand how you are using the lib.

Let me put it in this way. I implemented BBMetalImage pod into my project. It is simply working as following:
let source = BBMetalStaticImageSource(image: myImage!)
source.add(consumer: BBMetalAddBlendFilter())
myImage = BBMetalAddBlendFilter().bbimage
So I want to run this code when user clicks.

Firstly, you have to define your custom filters type by adopting the FMFilterable protocol.
For example:
MyFilter1: FMFilterable {
  func filter(image: UIImage) -> UIImage {
    // do whatever to get the filtered image synchronously.
    // https://github.com/Silence-GitHub/BBMetalImage#process-image-synchronously
  }
  func filterName() -> String {
    // return the name that will be used in the filter screen
  }
}

Then define all filters you want to use by assigning them to the availableFilters.
config. availableFilters = [
  MyFilter1(),
  MyFilter2(),
  MyFilter3(),
  // ...
]

Then instantiate FMPhotoPicker or FMPhotoEditor
let editor = FMImageEditorViewController(config: config, sourceImage: yourImage)

let picker = FMPhotoPickerViewController(config: config)

And now you can see your custom filters in the filter screen.

I really really appreciate for your support. It did work!
One more question: When I add config.availableFilters = [MyFilter()], it removes all previously built filters. How can I append, instead of overwrite the existing ones.

You can config like this:
config.availableFilters = [
    FMFilter.None,
    FMFilter.CIPhotoEffectChrome,
    FMFilter.CIPhotoEffectInstant,
    FMFilter.CIPhotoEffectMono,
    FMFilter.CIPhotoEffectProcess,
    FMFilter.CIPhotoEffectTransfer,
    FMFilter.CISepiaTone,
    FMFilter.CIPhotoEffectNoir,
    FMFilter.CIMinimumComponent,
    FMFilter.CIColorPosterize,
    FMFilter.CIColorMonochrome,
    FMFilter.CIColorCrossPolynomial,
    FMFilter.CIColorCube,
    FMFilter.CIColorCubeWithColorSpace,
    FMFilter.CIColorInvert,
    FMFilter.CIFalseColor,
    FMFilter.CIPhotoEffectFade,
    FMFilter.CIPhotoEffectTonal,
    FMFilter.CIVignette,

    MyFilter1(),
    MyFilter2(),
    MyFilter3(),
    // ...
 Really appreciate for your support.


[stable/rabbitmq] Added extra secrets support

Added extraSecrets support to the chart.
This can be useful when combined with load_definitions to automatically create the secret containing the definitions to be loaded.

/assign @miguelaeh

@miguelaeh  do you mea the template that use them ? in templates/secrets.yaml

No, I didn't explain the question well, the PR creates a series of secret objects in the cluster, where are those secrets used? I mean, where are the content of the secret used?

@miguelaeh  I use the extraSecrets to create the secret containing the load_definition.json content as needed to use rabbitmq definition.
I combine the secret created with extraSecrets (the one that contains the definition) and the other features of the chart that already exist, this gives me something like this :
extraSecrets:
  load-definition:
    load_definition.json: |
      {
         ....
      }
rabbitmq:
  loadDefinition:
    enabled: true
    secretName: load-definition
  extraConfiguration: |
    management.load_definitions = /app/load_definition.json

This way everyhting is self-container in the chart, and the secret containing the rabbitmq definition belongs to the release rather than a secret manually created.
Is it more clear ?

Ah, okay that was what I wanted to know, you need to configure the secret and specify the name too. I though you were trying to automatically use the secret.
Thanks for the clarification.

It would be nice if you could add a section in the README.md clarifying that.

Yes, it doesn't change the way it worked before.
It's just a complementary parameter to let the chart manage the secret instead of having to manually create it.
I would have called it something more specific than extraSecrets if it was automatically enabling rabbitmq definitions (setting the secret name and extra configuration) but i am afraid it would be a breaking change.
extraSecrets was open enough to achieve what i needed and didn't introduce any breaking change so i did it this way.

@miguelaeh done

/ok-to-test
/lgtm


General Linear Models - One Sample t-test

The One Sample T-Test was missing from the original list.

Included in pull request 140.


Make it possible to have required fields in file groups

When a required field is in a field group make it unrequired when the field group is closed.

IssueHunt Summary

 bunysae has been rewarded.
Backers (Total: $120.00)

 danblah ($20.00)
 resetnetwork ($100.00)

Submitted pull Requests

#2153 Required attribute in field groups

Tips

Checkout the Issuehunt explorer to discover more funded issues.
Need some help from other developers? Add your repositories on IssueHunt to raise funds.

Thank you, please release this feature.


Add overloads for AsyncEnumerable.Scan that allow async accumulators

As noted in the commit messages themselves, it is subject to discussion whether these overloads should be renamed (eg. ScanAsync) since they might induce ambiguities between the different overloads (see modified unit tests).

We won't take this change right now, given it'd introduce a severe asymmetry in the API surface; all other functions passed to operators would need async overloads too. There's nothing that makes Scan special in this regard.

See https://github.com/Reactive-Extensions/Rx.NET/issues/194.

Closing due to age and incoming C# 8 features. Lets revisit if still an issue there.


Fixed the error in Issue 570

See #570 for detailed description of the issue
The result set may have been buffered, so instead of calling SQLGetData() directly, call get_data() defined in the derived classes, which might either call SQLGetData() or retrieve the data already buffered.

Coverage increased (+0.1%) to 72.454% when pulling 526c7dcac96d2d7c1da2b32b04e79a50badc9530 on yitam:streamData into 7309fb90b18cd93940f28c6928f152404accb675 on Microsoft:dev.

Codecov Report

Merging #952 into dev will increase coverage by 0.19%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##              dev     #952      +/-   ##
==========================================
+ Coverage   80.43%   80.62%   +0.19%
==========================================
  Files          25       25
  Lines        7758     7758
==========================================
+ Hits         6240     6255      +15
+ Misses       1518     1503      -15

Impacted Files
Coverage Δ

...p-7.1.27-src/ext/pdo_sqlsrv/shared/core_stream.cpp
0% <0%> (ø)
:arrow_up:

...x86/php-7.1.27-src/ext/sqlsrv/shared/core_stmt.cpp
86.15% <0%> (+0.47%)
:arrow_up:

...6/php-7.1.27-src/ext/sqlsrv/shared/core_stream.cpp
86.11% <0%> (+1.38%)
:arrow_up:

.../php-7.1.27-src/ext/sqlsrv/shared/core_results.cpp
71.71% <0%> (+1.64%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7309fb9...526c7dc. Read the comment docs.


Version 0.19 is not appearing on the gallery

The latest version appearing on the gallery as of Visual Studio for Mac 8.2.2 is 0.18.
Version 0.19 is not appearing and I couldn't find how to download the mpack directly.

There is a bug in the gallery where it does not publish the new version for later minor versions. I have published 0.19 for VS Mac 8.2.2 and VS Mac 8.2.1 which should be available if you click the Refresh button in the Extensions dialog.
The addins are also available from the addin page:
http://addins.monodevelop.com/Project/Index/121
I also publish them to my own addin server, since the main monodevelop.com gallery has had problems in the past:
https://github.com/mrward/monodevelop-addins/tree/gh-pages
In VS Mac 8.3, hopefully soon, Managing NuGet packages for the solution will be available in VS Mac by default, without needing the extension to be installed. The PowerShell console will not be included 'in the box' with VS Mac.


Problem

Problem encountered on https://dotnet.microsoft.com/learn/aspnet/hello-world-tutorial/create
Operating System: windows
Provide details about the problem you are experiencing. Include your operating system version, exact error message, code sample, and anything else that is relevant.****

Could you provide specific details on the problem you are having?

I can't save the file as Pages/Index.cshtml as Windows does not allow you
to Save a file using the '/' therefore I cannot run the file on Host 5000.
On Mon, 16 Sep 2019, 22:28 Lee Coward<EMAIL_ADDRESS>wrote:

Could you provide specific details on the problem you are having?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/dotnet/core/issues/3379?email_source=notifications&email_token=AKXRKZYWXVKVEF5JTT7B3ALQJ7T7FA5CNFSM4IXFZV5KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD62NH6I#issuecomment-531944441,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AKXRKZ5IYUJ4ZLJLCSAS4G3QJ7T7FANCNFSM4IXFZV5A
.

If you followed the tutorial correctly, you will have the Index.cshtml file in the Pages subdirectory of the myWebApp directory. That's the file you're supposed to edit.

@Nurbrock7 did @svick's suggestion resolve your issue?

Closing this out; please feel free to re-open with more info if you're still having the issue.


Update Python requirement to 3.6

Cartography requires Python 3.6 (e.g. in its' use of Literal String Interpolation), so update the readme to reflect that.

Thanks for this!  Will merge after CI is done.


Blufi not returning SSID list

Hi we are trialing use of the blufi system for a product and we have found that with the current release ESP-AT firmware on a ESP32-C3 module we are not getting an SSID list back when running that blufi command, it is not returning any errors just also no SSIDs
Is this a known issue with the AT fimware or is it an issue with the app?
Many Thanks,
Matt

Further detail, we are sending a "Get the Wi-Fi list" command (0x9) and we are not receiving the followup frames as suggested in the documentation.

This issue is happening with both our own javascript implementation and the blufi demo app provided by Espressif.

Hi we are trialing use of the blufi system for a product and we have found that with the current release ESP-AT firmware on a ESP32-C3 module we are not getting an SSID list back when running that blufi command, it is not returning any errors just also no SSIDs
Is this a known issue with the AT fimware or is it an issue with the app?

Many Thanks, Matt

Hi,
Please download the AT firmware on the latest master branch from github to test this function. This function is only supported on AT not long ago. There is no release version that supports this function.

We assume this worked for you, and will close it. If that's not the case, please open another github issue.


Enabling/Disabling of LSO/TSO

VMware states that for performance reasons when virtualizing Windows machines one might want to disable TSO/LSO .
Is this something that would be beneficial to add to xNetworking as a new resouce xNetAdapterLso ?

Hi @gammalost - absolutely - that sounds like something that belongs in here. We should already have a similar resource pattern floating around here somewhere that would be easy to clone and modify to suit this purpose.

@PlagueHO Great! I'll get on it right away.


Switch DE

Currently there is no way to switch the DE upon login.

I'll have a look at implementing this. Feel free to give it a go if you have time

how do I build the project?
I get this error: sh: line 1: node_modules/gulp/bin/gulp.js: No such file or directory

It's been a while since I've developed but just got it running, you may need an old version of node to be installed (doesn't matter too much because it's just for building). I used nvm to do this. This worked for me:
$ nvm install 10
$ nvm use 10
$ rm package-lock.json
$ npm install
$ npm run dev

Then open your browser to http://localhost:8000. If you get an error like failed to GET / restart the server and refresh. These steps worked for me.

question: why do you use sass and not scss?

I think I just preferred it 6 years ago

Do you want me to convert it to scss? or do you still prefer it today?

Feel free to change

Hey, hope you're doing well. I finally had free time and rewrote the whole project. Quad
Thanks for the great project!

No worries, good to see it have some attention :) I no longer daily drive linux so it wasn't something I had planned to work on in the foreseeable future


Update http4s-blaze-client, ... to 0.20.0-M7

Updates

org.http4s:http4s-blaze-client
org.http4s:http4s-blaze-server
org.http4s:http4s-circe
org.http4s:http4s-dsl
org.http4s:http4s-server

from 0.20.0-M6 to 0.20.0-M7.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention @scala-steward in the comments below.
Have a nice day!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [{ groupId = "org.http4s" }]

There is some error with Travis downloading SBT right now. Verified this patch works locally.


Replace Bourbon grid system with modern CSS practices

Flexbox has better support for ensuring things are of matching height.

Gonna strongly favor Grid over flexbox for grid-making -- flexbox grids always wind up failing one at inopportune moments.

Sounds good! What is Grid?

UTTERLY AMAZING AND BEAUTIFUL is what it is.
https://alistapart.com/article/practical-grid
https://alistapart.com/article/the-new-css-layout-excerpt
https://gridbyexample.com/


websockets and Digital Pin support

hi Alex,
in resetfull API i can control any Digital - D - Pin or Virtual - V - Pin , but in your Node only virtual
Pin can be communicated , i know that in sketch this can be solved very easily.
but is this a limitation of your Node or Blynk Websockets API.
thanks

hi, node red acts as a hardware device, and uses the API Blynk provided to connect as a device.
because of that, it can't really switch digital pins as it doesn't know of any.
it might be possible through a bridge widget, but i did not look into that at all, so don t know what to tell you.

thanks Alex.
it's fine now we have 128 V pin so no issue , and throw sketch this can be solved.


Typo on Docker Run command

I was doing a step by step execution on my local machine based on this docs, then I've noticed that there's a typo on the Docker run command:
docker run --rm -it -p 5000:5000 --memory 4g --cpus 1
containerpreview.azurecr.io/microsoft/ognitive-services-face
Eula=accept
Billing={BILLING_ENDPOINT_URI}
ApiKey={BILLING_KEY}
The image name should be: containerpreview.azurecr.io/microsoft/cognitive-services-face and not "ognitive-services-face"

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 889b34f3-060f-4507-32db-63d5a33cfd4c
Version Independent ID: 74032f30-05bd-ea1f-4504-3444ba065c8b
Content: Install, run containers
Content Source: articles/cognitive-services/Face/face-how-to-install-containers.md
Service: cognitive-services
GitHub Login: @diberry
Microsoft Alias: diberry

@prtdomingo Great catch. Thank you for letting me know. #in-progress.


BT Controller - Stops Scanning or responding after random amount of time (IDFGH-1781)

Brief
I have been having a problem with the Bluedroid BT Controller Scanning function for a few weeks now, and after trying many different things, I am stuck and am not sure what else I can try.
The crux of the issue is that the BLE Scanning feature will work for a large amount of time - up to 3 days, then just fail silently, with the whole BT controller seemingly shutting down.
Problem Description
I have a BLE Scanning app that is working well for the most part. It spends most of its time performing an active scan for other BLE devices that are advertising a service UUID and some custom manufacturer data. It receives an advertisement from a sensor around every 1 second, but I can have anywhere from 1-10 sensors within range at any one time.
After a completely random period of time, sometimes 20 minutes, sometimes 3 days. The App will stop receiving ESP_GAP_SEARCH_INQ_RES_EVT events from the bt layer, even though it should still be receiving advertisements form multiple devices, with no indication from any underlying BT Controller debugging that anything has happened. This happens no matter how many sensors I have within range of the ESP, advertising the device, it even happens when I have no sensors advertising, and the general BVLE background advertisements are relatively low.
The free heap memory of the app stays the same (~140kB free memory at any one time), so I can rule out a memory leak on the app side, and the rest of the application keeps running normally, albeit with more computation time from the RTOS (indicated by a loop counter that increases when this error happens), So clearly some of the BT Tasks have stopped running.
When the error happens, I can also see that the ESP itself DOES STOP performing Active scanning, as The sensors I use flash an LED whenever they receive a SCAN_REQUEST from the ESP32 Hardware MAC Address, and this stops happening as soon as the error starts.
If I try and recover from the error, by issuing a command such as esp_ble_gap_start_scanning() - which responds ESP_OK, I get a HCI timeout error printed: BT_HCI: command_timed_out hci layer timeout waiting for response to a command. opcode: 0x200c.
At the moment, trying to perform a bt command after the error, and getting this response, is the only indication from the application that something has gone wrong.
I am not using any WiFi functions, so to reduce memory footprint and file size, I have changed the linker script to only include the following libraries in the component.mk of esp32:
core rtc phy instead of the usual: core rtc net80211 pp wpa smartconfig coexist wps wpa2 espnow phy mesh
Coredump
coredump
This is a coredump taken about 20 minutes after the error occured. I forced this core dump to log by deliberately throwing an IntegerDivideByZero Exception in another task. My hope here is that it saved the task state of the BT tasks, which your team can use internally to see the task state. If you require My APP ELF I can provide this by email.
Debug Log
This is a log showing the lack of errors I receive when the error happens. As you can see, the application was running for 2.5 days before the error occured. The 'BMS' TAG is my application, and the 'Scanning started' and 'scanning stopped' logs are when my app receives the ESP_GAP_SEARCH_INQ_CMPL_EVT and ESP_GAP_BLE_SCAN_START_COMPLETE_EVT events respectively. In this application, I start a esp_ble_gap_start_scanning operation of 30 seconds, and when I receive a ESP_GAP_SEARCH_INQ_CMPL_EVT event, i set a flag to restart the esp_ble_gap_start_scanning of 30 seconds, in a cycle. Although as discussed later, I have tried changing this interval to anywhere from 30 seconds to 5 minutes, and I have also tried setting the interval to 0 for unlimited, so I only call the start_scan once.
In this instance, my pplication received the ESP_GAP_SEARCH_INQ_CMPL_EVT event, so set a flag internally to call esp_ble_gap_start_scanning(30) again, which responded with ESP_OK, but I never received the ESP_GAP_BLE_SCAN_START_COMPLETE_EVT, and about 8 seconds later, I see an error log of command timeout.
I (210356607) BMS[scanning]: Scanning Stopped
I (210356607) BMS[scanning]: Scanning started
I (210363327) main: HEAP - free: 140560, largest_block: 98108 | PSRAM - free: 3451316, used: 202360, attempted: 981230 | pps: 21, lps: 248
I (210373357) main: HEAP - free: 140560, largest_block: 98108 | PSRAM - free: 3451316, used: 202360, attempted: 981230 | pps: 20, lps: 249
I (210383367) main: HEAP - free: 140560, largest_block: 98108 | PSRAM - free: 3451316, used: 202360, attempted: 981230 | pps: 19, lps: 247
I (210386607) BMS[scanning]: Scanning Stopped
I (210386617) BMS[scanning]: Scanning started
I (210393387) main: HEAP - free: 140560, largest_block: 98108 | PSRAM - free: 3451316, used: 202360, attempted: 981230 | pps: 21, lps: 248
I (210403407) main: HEAP - free: 140560, largest_block: 98108 | PSRAM - free: 3451316, used: 202360, attempted: 981230 | pps: 19, lps: 248
I (210413457) main: HEAP - free: 140560, largest_block: 98108 | PSRAM - free: 3451316, used: 202360, attempted: 981230 | pps: 19, lps: 249
I (210416617) BMS[scanning]: Scanning Stopped
I (210423487) main: HEAP - free: 140560, largest_block: 98108 | PSRAM - free: 3451220, used: 202452, attempted: 981230 | pps: 17, lps: 250
E (210424617) BT_HCI: command_timed_out hci layer timeout waiting for response to a command. opcode: 0x200c
I (210433497) main: HEAP - free: 140560, largest_block: 98108 | PSRAM - free: 3451220, used: 202452, attempted: 981230 | pps: 25, lps: 250

sdkconfig
sdkconfig
Scanning Configuration Used
These are the configurations currently in use, but as you'll see below I have tried many different
static esp_ble_scan_params_t logging_ble_scan_params = {
    .scan_type              = BLE_SCAN_TYPE_ACTIVE,
    .own_addr_type          = BLE_ADDR_TYPE_PUBLIC,
    .scan_filter_policy     = BLE_SCAN_FILTER_ALLOW_ALL,
    .scan_interval          = 0x100,
    .scan_window            = 0x100,
    .scan_duplicate         = BLE_SCAN_DUPLICATE_DISABLE
};

Changes Attempted
Below is a list of sdkconfig changes of application setup/operation changes that I have tried, with no success , the same thing occurs.

Unlimited scanning timeout - when done this way, I never even get an indication of hci_layer_timeout, because i never try to run another esp_ble_gap_start_scanning call, so the bt controller will fail silently
Turning CONFIG_BLUEDROID_MEM_DEBUG ON - There is no debugging information around the time the error happens
CONFIG_BT_BLE_DYNAMIC_ENV_MEMORY ON/OFF
CONFIG_BT_ALLOCATION_FROM_SPIRAM_FIRST ON/OFF
CONFIG_BLE_HOST_QUEUE_CONGESTION_CHECK ON/OFF
Scanning interval/window change to many different values: 0x100/0x50, 0x200/0x50, 0x1000/0x100, and a few more.
180 second scanning timeout - This seems to make the error happen quicker, although that may be placebo as I only tested a few times.
Increase CONFIG_BTC_TASK_STACK_SIZE and CONFIG_BTU_TASK_STACK_SIZE
Not calling esp_bt_controller_mem_release(ESP_BT_MODE_CLASSIC_BT) (which I usually call before enabling anything.
Enabling/disbling WiFi coexist (I am not using WiFi function at all

If there is anything else I should try, please let me know.
Apologies for the large Github issue, this error has been troubling me for some time and I would like to know what I can try next. Thank you.
Environment

Key
Value

Development Kit
Custom Board

Module or chip used
ESP32-WROVER-32

IDF version
91f29bef172a082cbd8f0208ed1757ede0e1d635 - tracking release/v3.3

Build System
Make

Compiler version
crosstool-ng-1.22.0-80-g6c4433a

Operating System
macOS

Power Supply
external 3.3V

One thing to note which I just thought of, I am compiling with Arduino-ESP32 as a component.
I am not sure if that would affect anything as I am using esp-idf for all the bluetooth-related functionality, as i found the BLE library in Arduino a bit too resource-intensive.

Hey @igrr (Don't know who else to @), woukd someone be able to have a look at this, this issue is still ongoing for me.

Hello, sorry for the late reply. Do you added a lot of printing in esp_gap_cb? I recommend that you turn off some unnecessary printing, such as remove the print of device name and address from when scanning. This is not the final solution, but try to see if the issue is resolved.Thank you.

Hi @gengyuchao, thanks for your reply.
I do no printing in esp_gap_cb, and i also keep my processing time to a minimum, by adding most events to a queue via xQueueSendFromISR and processing them in another thread.

According to your description, I have not been able to reproduce the problem. Can you give me a sample code of your problem? So I can try to track this problem, thank you.

Hi @gengyuchao,
The problem can take anywhere from 20 minutes to 3 days to happen, and my app is not able to be shared in its current state, however i can share the elf to analyse the coredump if you like.
I will try to build a smaller program that can reproduce the issue.
It seems that the error is that the pre-compiled bt lib is the component that is crashing.
Is there anyway i can diagnose the current state of the esp32 bt lib when i detect an error?

Seems to be related to #4196

Hi @prasad-alatkar is there any update on this or Issue #4196 ?
We are about to enter production and this is still an ongoing issue for us, we are having to call esp_restart every time the BT Controller fails, which is not ideal.

@One

Hi @prasad-alatkar is there any update on this or Issue #4196 ?
We are about to enter production and this is still an ongoing issue for us, we are having to call esp_restart every time the BT Controller fails, which is not ideal.

We are working on BT controller firmware fix for the issue. In BLE scan scenario, couple of issues are observed where BT controller reboots with controller level malfunction error code OR just stops responding without any known error. Issue is related to the handling of scan reports in BT controller when there are large number of scan reports in short frame of time. We will release the further details and updated bt lib as soon as possible.
Thanks.

Thanks for your prompt response, good to know you have identified the issue source. Look forward to applying a fix!

Hi @csushantk
I noticed that a few commits were pushed to the Github repo recently, can you please confirm if your fix for this issue was included?
I am tracking release/v3.3 for my IDF toolchain.
I am testing this latest release now.
Thanks.

Observing the same issue with v4.0-beta2. Any news here? This is really urgent for us.

The same issue in v3.3.1.
Like a ugly workaround, we restart the chip if scan_result->scan_rst.num_resps (in ESP_GAP_SEARCH_INQ_CMPL_EVT) not changed during five scans.
It is strange that scan_result->scan_rst.num_resps is not reset between scans.

Any updates from anyone on this bug? Still an issue with the latest release/v3.3 branch

I update out firmware to v4.1 (this error did not reproduce in v4.1).

Hello @Sushant-Espressif ,
I'm having the same issue of @0neblock with the same "fw environment". I'm using ESP-IDF v4.3-dev-907-g6c17e3a64.
Any update about this problem?
Regards,
Gianluca.

@GianlucaLoi @0neblock In our local setup, with Bluedroid Host, we are not able to reproduce the issue of "BLE stops scanning randomly" (tested for one week continuously).
Can you please provide more details to reproduce this issue?

Are there excessive prints in your application?
Is application task set to higher priority and hogging the CPU?
Is it possible to share any other details about the application so that we can quickly reproduce the issue?

@GianlucaLoi @0neblock In our local setup, with Bluedroid Host, we are not able to reproduce the issue of "BLE stops scanning randomly" (tested for one week continuously).
Can you please provide more details to reproduce this issue?

Are there excessive prints in your application?
Is application task set to higher priority and hogging the CPU?
Is it possible to share any other details about the application so that we can quickly reproduce the issue?

Hello @Sushant-Espressif ,
Thanks for the response.
> 1. Are there excessive prints in your application?
I have very few prints when my fw is ongoing. At point 3 you can see an example.
> 2. Is application task set to higher priority and hogging the CPU?
Could you be more specific?
> 3. Is it possible to share any other details about the application so that we can quickly reproduce the issue?
In my application I have WiFi (STA mode), MQTT (no SSL) and BLE.
What my FW does is:

At the startup it waits for a WiFi Smart Configuration,
Once is connect to the WiFi, MQTT and BLE task will be initialized and a periodic active scan starts (period about 5seconds) and a task (TASK1) is created to manage the scan data of ble to send the data by MQTT
If there is any data that needs to be publish, MQTT publish function is called by the TASK1
The FW so remains scanning and sending with 5 second period. An example of prints is shown below

I (1231732) TASK1: [APP] Free memory: 4220620 bytes
I (1231746) BLE: Scan started
I (1231833) MQTT: MQTT_EVENT_DATA
I (1236748) BLE: Scan restarting...
I (1236748) TASK1: [APP] Free memory: 4222208 bytes
I (1236751) BLE: SCAN PARAM SET COMPLETE
I (1236763) BLE: Scan started
I (1241765) BLE: Scan restarting...
I (1241768) BLE: SCAN PARAM SET COMPLETE
I (1241773) MQTT: sent publish successful, msg_id=0
I (1241773) TASK1: [APP] Free memory: 4220496 bytes
I (1241815) MQTT: MQTT_EVENT_DATA
E (1249770) BT_HCI: command_timed_out hci layer timeout waiting for response to a command. opcode: 0x200c

If you need more information, I will be glad to give them.
Regards,
Gianluca.

Hello @Sushant-Espressif ,
Do you have any update about this problem?
Regards,
Gianluca.

Hi @GianlucaLoi
Can you tell us that if you are using advertising report flow control and scan duplicate filtering options?
These options can be found in sdkconfig under name CONFIG_BTDM_BLE_ADV_REPORT_FLOW_CTRL_SUPP and CONFIG_BTDM_BLE_SCAN_DUPL.

Hello @chhajedji
They are both set as YES.
Regards,
Gianluca.

Hi @GianlucaLoi
We tried to reproduce your issue, but we didn't get any success. Can you follow below steps and share the logs with us.

Apply this patch present in the attached tarball and also replace the bt lib at $IDF_PATH/components/bt/controller/lib/libbtdm_app.a by the lib in tarball.
Run your program and when crash occurs, store all the logs in a file.
This tarball contains a patch for esp-idf and a bt lib. These are not official versions, but just to get the logs of exact scenario.
gh_timeout.tar.gz

Hello @chhajedji
I performed your steps but, in the Linker section, I obtain these errors:

undefined reference to `ke_task_env'
undefined reference to `ke_handler_search'
undefined reference to `ld_pscan_frm_cbk'

How can I solve them?
Regards,
Gianluca.

Can you try doing a git fetch and git submodule update --init --recursive.
Since you are using current master branch and it is getting updated frequently, You will have to do a git checkout 0289d1cc81c210b719f28c65f113c45f9afd2c7b as I have created given patch on this commit.
Also note that you will have to first update submodules (git submodule update --init --recursive) then replace given library. And similarly git fetch and git checkout 0289d1cc81c210b719f28c65f113c45f9afd2c7b and then apply given patch.

Hello @chhajedji
I'm still doing your test because I have to adapt some function to your repository to work well.
In the meanwhile I tested the ESP-IDF v4.1 and I see this problem also with that version.
One more information to understand the problem (maybe):
Because I need an active scan, every 5 seconds I re-set the scan params. When this phase is complete I restart the scanning.
`
...
case ESP_GAP_BLE_SCAN_PARAM_SET_COMPLETE_EVT:
if(param->scan_param_cmpl.status == ESP_BT_STATUS_SUCCESS)
{
ESP_LOGI(BLE_LOG_TAG,"SCAN PARAM SET COMPLETE");
esp_ble_gap_start_scanning(5);
}
else
{
ESP_LOGE(BLE_LOG_TAG,"SCAN PARAM SET NOT COMPLETE");
}
break;
...
case ESP_GAP_SEARCH_INQ_CMPL_EVT:
...
esp_ble_gap_set_scan_params(&ble_scan_params);
break;
...
`
Regards,
Gianluca.

Hi @GianlucaLoi
I am also testing with this parameters and see if I can reproduce it. In case you get the crash, please share the logs.

Hello @chhajedji and @0neblock
I haven't tried your suggestion yet but it seems I resolved with these modifications in the SDK:

Bluetooth Event Stack Size from 3072 -> 4096
Use Dynamic allocation in BT/BLE stack
BT/BLE will first malloc on PSRAM

In your opinion, is this setting a valid solution for this problem?
Regards,
Gianluca

HI @vbvchauthmal Your ESP-IDF version looks bit old. This issue has been backported in the commit 86de4055 for v3.3 release. We have released v3.3.5 which also contains the fix. Please try with this version.

Hi @chhajedji,
I have updated the ESP-IDF version to v3.3.5 and executed submodules update using command git submodule update --init --recursive.
After IDF version upgrade, my firmware build is getting failed with following logs :
Python requirements from /home/yantrr/git-repos/OMNY_rel2_3/src/esp-idf/requirements.txt are satisfied.
Building partitions from /home/yantrr/git-repos/OMNY_rel2_3/src/HUB-FW/partitions.csv...
usage: espsecure sign_data [-h] --version {1,2} --keyfile KEYFILE
                           [KEYFILE ...] [--output OUTPUT]
                           datafile
espsecure sign_data: error: argument --version/-v is required
/home/yantrr/git-repos/OMNY_rel2_3/src/esp-idf/components/partition_table/Makefile.projbuild:53: recipe for target /home/yantrr/git-repos/OMNY_rel2_3/src/HUB-FW/build/partitions.bin' failed
make[1]: *** [/home/yantrr/git-repos/OMNY_rel2_3/src/HUB-FW/build/partitions.bin] Error 2
Makefile:49: recipe for target 'firmware' failed
make: *** [firmware] Error 2

Hi @chhajedji,
Do you have any update on this?
I have included BT controller & VHCI and Bluedroid get status API call in my code where I am observing following error logs when BLE scan is stopped or not responding before I executes esp_restart() for reboot :
yantrr@yantrr-ws2:rel2-test$ egrep "scan_evt timeout|ble_timer_scan_fail_count|Get BLE TX power for PWR_TYPE_SCAN|BT controller status|BT controller status|vhci host check for sending packet to controller|BT_HCI|Version:|IDF" usb2_2021-05-14-22.22.02.log
I (1057) cpu_start: ESP-IDF:          v3.3.5-dirty
I (6090) [APP-MAIN]: Version: v2.3.2-beta8-ohirel2_3   MacID: 24:62:ab:ef:b2:88
scan_evt timeout
E (3005880) BT_HCI: command_timed_out hci layer timeout waiting for response to a command. opcode: 0x200c
I (3033940) [BLE-MASTER]: ble_timer_scan_fail_count : 1
I (3033940) [BLE-MASTER]: ble_timer_scan_fail_count failed, esp_restart()
I (3033940) [BLE-MASTER]: Get BLE TX power for PWR_TYPE_SCAN : 5
I (3033950) [BLE-MASTER]: BT controller status : 2
I (3033950) [BLE-MASTER]: vhci host check for sending packet to controller, status : 1
I (3033950) [BLE-MASTER]: Bluedroid Status : 2
I (1055) cpu_start: ESP-IDF:          v3.3.5-dirty
I (6104) [APP-MAIN]: Version: v2.3.2-beta8-ohirel2_3   MacID: 24:62:ab:ef:b2:88
scan_evt timeout
scan_evt timeout
E (6569124) BT_HCI: command_timed_out hci layer timeout waiting for response to a command. opcode: 0x200c
I (6616944) [BLE-MASTER]: ble_timer_scan_fail_count : 1
I (6616944) [BLE-MASTER]: ble_timer_scan_fail_count failed, esp_restart()
I (6616944) [BLE-MASTER]: Get BLE TX power for PWR_TYPE_SCAN : 5
I (6616954) [BLE-MASTER]: BT controller status : 2
I (6616954) [BLE-MASTER]: vhci host check for sending packet to controller, status : 1
I (6616954) [BLE-MASTER]: Bluedroid Status : 2
I (1055) cpu_start: ESP-IDF:          v3.3.5-dirty
I (6104) [APP-MAIN]: Version: v2.3.2-beta8-ohirel2_3   MacID: 24:62:ab:ef:b2:88
scan_evt timeout
E (4419764) BT_HCI: command_timed_out hci layer timeout waiting for response to a command. opcode: 0x200c
I (4538624) [BLE-MASTER]: ble_timer_scan_fail_count : 1
I (4538624) [BLE-MASTER]: ble_timer_scan_fail_count failed, esp_restart()
I (4538624) [BLE-MASTER]: Get BLE TX power for PWR_TYPE_SCAN : 5
I (4538634) [BLE-MASTER]: BT controller status : 2
I (4538634) [BLE-MASTER]: vhci host check for sending packet to controller, status : 1
I (4538634) [BLE-MASTER]: Bluedroid Status : 2
I (1055) cpu_start: ESP-IDF:          v3.3.5-dirty
I (6104) [APP-MAIN]: Version: v2.3.2-beta8-ohirel2_3   MacID: 24:62:ab:ef:b2:88

I have included sdkconfig parameters suggestion mentioned by @GianlucaLoi, but didn't helped in resolving this issue.

We've noticed this same issue on multiple versions of the IDF (v3.3.3, v4.1, v4.2, v4.2.1). BLE scanning and BLE server advertising will stop at intermittent times and require a power cycle to fix. Sometimes this happens after an hour, sometimes after a few days. We've implemented a daily reboot and have attempted to implement a system where a reboot will happen if the scan event hasn't fired for awhile. We've tried many different configurations, but nothing has worked to resolve the issue. It seems to happen more frequently when a lot of BLE devices are around with scanning. This is a major concern for us.

Same here, even switched to entirely different SoC for a large-volume product because of this.

Hi @vbvchauthmal,
I will trying to recreate the issue. Although I tried same earlier for @GianlucaLoi and before I could recreate it, changing some parameters helped for them. Please share some more details about your failing scenario through which I can reproduce it.

Which commit id are you using for your application?
What exactly are you doing in your application (scanning/advertising/both, anything else also) and what are the parameters for the same (scan params, adv params)?
Which idf example will most closely resemble your application and what are the changes in it to emulate your scenario. Or if you can share your application, that would be better.
How many devices are there in the vicinity and what are they doing (how many advertisers and scanners nearby)?
How long does this issue take to occur for your case and does this time vary?

Also please provide any other information you feel which could be helpful to recreate or solve this issue.

Hi @chhajedji

Hi @vbvchauthmal,
I will trying to recreate the issue. Although I tried same earlier for @GianlucaLoi and before I could recreate it, changing some parameters helped for them. Please share some more details about your failing scenario through which I can reproduce it.

I am using ESP-IDF version v3.3.5 (commit id : 03810c4a065a1ecdd24a803b2c9dc4e834c7dab5) after your suggestion, earlier I was using v3.3.1 (commit-id : 143d26aa49df524e10fb8e41a71d12e731b9b71d )

* What exactly are you doing in your application (scanning/advertising/both, anything else also) and what are the parameters for the same (scan params, adv params)?

I am doing BLE scanning and below are the scan parameters set in my source code :
ble_scan_params = {
    .scan_type              = BLE_SCAN_TYPE_ACTIVE,
    .own_addr_type          = BLE_ADDR_TYPE_PUBLIC,
    .scan_filter_policy     = BLE_SCAN_FILTER_ALLOW_ALL,
    .scan_interval          = 0xF0,                         // Interval between the start of two consecutive scan windows. Dec(0xF0) = 240 x 0.625 = 150ms
    .scan_window            = 0xF0                          // The duration in which the Link Layer scans on one channel. Dec(0xF0) = 240 x 0.625 = 150ms
};

* Which idf example will most closely resemble your application and what are the changes in it to emulate your scenario. Or if you can share your application, that would be better.

The idf example closely resemble with my application is gattc_multi_connect. This application extended with setting of BLE GAP security parameters and supporting interfacing of five BLE peripheral devices. At a time only one BLE peripheral will be allowed to connect when its broadcasting is captured to get sensor readings i.e. through BLE notifications/indications.

* How many devices are there in the vicinity and what are they doing (how many advertisers and scanners nearby)?

Till now we have deployed 6000 of our ESP32 based platform with this developed firmware and all must have different numbers of BLE devices in vicinity which can be advertisers or scanners. Most of these deployed showing this issue.

* How long does this issue take to occur for your case and does this time vary?

Its occurring at random sometimes it will arise after week or sometimes it will take few minutes or hours.

Also please provide any other information you feel which could be helpful to recreate or solve this issue.

Query :

Is there any API (for checking the Bluetooth radio / BLE scanning status) which I can execute for knowing the BLE scan is stopped or hanged? I observed sometimes this issue reproduced without any BT_HCI errors in log, so wanted to get status of underlying BLE scan so I can reset bluetooth instead of executing esp_restart().
What is the proper sequence to reset bluetooth ?

We are facing the same issue
We are working with 4.2.1 release, we tried also  v4.3-beta3 tag and also v4.4-dev tag and the issue is also there.
When this issue occur, BT radio status looks good no error reported so software cannot detect this...
We tried many option to reset BT only, but scan not operational after that.
Only esp_restart() recover but we cannot use it since in our app we cannot loose BT radio more than 1 minute ( it not applicable for us to run esp_restart() every minute!!).

@Rokachy Can you please try with the latest v4.3 release? We did a test and did not reproduce the issue. We are still testing with mass devices on the same.

Yes, I will and let you know for results.
Is a random issue,  it can appear from few hours to few days....
Is there anything that I can read / get status from the device to help debug it?
Do you want me to open/enable other than logs?
Yehuda

@Rokachy Yes, it is a random issue. Am afraid no need to enable anything at the moment, the best would be packets capture. Please try with latest v4.3 first. Thanks.

Its runs with v4.3 release for a few days, no issue so far  -:)
We will continue to run it for few days more.
What have been fixed at the SDK v4.3?

@TianaESP Any chances of this (possible) fix being backported to v3.3?

@0neblock The fixes were backported to v3.3, v4.0, v4.1, v4.2. Please try the latest v3.3.
Thanks.

@Rokachy We fixed bugs in modem sleep that we suspected were contributing to the problem. Please let us know if the issue happens again. Thanks.

Thank you for the support, we are using release 4.3 and we didn't see the
issue for the last 2 weeks. I hope it will be kept like this 😀.
Thank you for the good work.
Yehuda
On Mon, Jun 28, 2021, 14:46 TianaESP @.***> wrote:

@Rokachy https://github.com/Rokachy We fixed bugs in modem sleep that
we suspected were contributing to the problem. Please let us know if the
issue happens again. Thanks.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/espressif/esp-idf/issues/4001#issuecomment-869615461,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AS7K4PJZQ6Z4A7UH2VWTDPTTVBOIVANCNFSM4ITBESYQ
.

The fixes were backported to v3.3, v4.0, v4.1, v4.2. Please try the latest v3.3.

is the fix backported to 4.0.3 version too?

Thanks for sharing updates, the fix has already backported to release/4.0 https://github.com/espressif/esp-idf/commit/b89b1ec0223d4f021ce401a8f85e751dd67c8358, thanks.

I have observed an issue, which might relate to this. At least the result is the same: BLE stack stops to work properly...
In my situation, I am scanning for BLE advertisements, and at some point in time, the scan stops. It typically happens when ESP32 is busy (e.g. writing a lot of information to Debug Console).
I enabled "CONFIG_BLE_HOST_QUEUE_CONGESTION_CHECK", which helps a lot, and actually shows, that BTU queue "often" has congestion.
But I also observed (easy to reproduce by changing "BT_QUEUE_CONGEST_SIZE" to 20 in file "bt_common.h"), that when congestion occurs, it actually locks the ble stack completely.
Sometimes it does not recover, and I believe it is caused by "hciH4T" task having higher priority - and a lot event to process.
If I allow "hciH4T", "btuT" and "BTC_TASK" tasks to use same priority, I do not see this lockup.
Perhaps someone from Espressif could confirm the issue?

Hi! Any update about this? I noticed this same issue when using BLE + Classic (v4.4-beta1). Thanks!

We are using 4.3.1 and we are not seeing the issue
On Thu, Dec 30, 2021, 18:53 Juan Ávila @.***> wrote:

Hi! Any update about this? I noticed this same issue when using BLE +
Classic (v4.4-beta1). Thanks!
—
Reply to this email directly, view it on GitHub
https://github.com/espressif/esp-idf/issues/4001#issuecomment-1003106488,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AS7K4PPKJ26AMQ5UEROFOM3UTSE7LANCNFSM4ITBESYQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you were mentioned.Message ID:
@.***>

We are using 4.3.1 and we are not seeing the issue
…
On Thu, Dec 30, 2021, 18:53 Juan Ávila @.> wrote: Hi! Any update about this? I noticed this same issue when using BLE + Classic (v4.4-beta1). Thanks! — Reply to this email directly, view it on GitHub <#4001 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AS7K4PPKJ26AMQ5UEROFOM3UTSE7LANCNFSM4ITBESYQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub. You are receiving this because you were mentioned.Message ID: @.>

Are you using bluedroid (with BTDM mode)? With only ble scan I can't reproduce it

We are using ble scan.
On Fri, Jan 7, 2022, 12:48 Juan Ávila @.***> wrote:

We are using 4.3.1 and we are not seeing the issue
… <#m_6376715294096464826_>
On Thu, Dec 30, 2021, 18:53 Juan Ávila @.> wrote: Hi! Any update about
this? I noticed this same issue when using BLE + Classic (v4.4-beta1).
Thanks! — Reply to this email directly, view it on GitHub <#4001 (comment)
https://github.com/espressif/esp-idf/issues/4001#issuecomment-1003106488>,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AS7K4PPKJ26AMQ5UEROFOM3UTSE7LANCNFSM4ITBESYQ
https://github.com/notifications/unsubscribe-auth/AS7K4PPKJ26AMQ5UEROFOM3UTSE7LANCNFSM4ITBESYQ
. Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you were mentioned.Message ID: @.>
Are you using bluedroid (with BTDM mode)? With only ble scan I can't
reproduce it
—
Reply to this email directly, view it on GitHub
https://github.com/espressif/esp-idf/issues/4001#issuecomment-1007312832,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AS7K4PI44ASQV3SNT4M75BTUU3AI7ANCNFSM4ITBESYQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you were mentioned.Message ID:
@.***>

Using the latest Arduino ESP32, v 2.0.2 that uses idf 4.4-alpha1 I also get the error "BT_HCI: command_timed_out hci layer timeout waiting for response to a command. opcode: 0x200c"
When this happens I also see that the application reconnects to WiFi as I have WiFi / BLE co-existence. BLE scanning for 1 second at the time, then a short break before I start scanning again.

Using the latest Arduino ESP32, v 2.0.2 that uses idf 4.4-alpha1 I also get the error "BT_HCI: command_timed_out hci layer timeout waiting for response to a command. opcode: 0x200c"
When this happens I also see that the application reconnects to WiFi as I have WiFi / BLE co-existence. BLE scanning for 1 second at the time, then a short break before I start scanning again.

+1, although the changelog includes this bug fix, it hasn't been resolved in the latest version yet. Also, since the bluetooth controller code is not open source, it is not possible to do anything on our side...

i have bad news and good news.
bad news - the test failed after continuous scanning for about 60 hours, with the same Scan_evt Timeout error and everything fell into a deadlock. so adding the delay did not solve the problem.
however, good news is - i have successfully force the board to reboot when this error happens, by using Task Watchdog Timer (TWDT) .
here are the code fragments -
#include <esp_task_wdt.h>
..
int _T;
int scanTime = 2; //In seconds
int scanInterval = 10; //In mili-seconds
void setup() {
...
  esp_task_wdt_init(3, true); //enable panic so ESP32 restarts, interrupt when task executed for more than 3 secons
  esp_task_wdt_add(NULL); //add current thread to WDT watch
  _T = millis();
...
}
void loop() {
  for(int i=0; i<1000; i++){
    Serial.printf("<%d>\n",i);
    delay(scanInterval);
    if(!scanBLE()){
      initBLEScan();
      esp_task_wdt_reset(); // reset the watchdog timer
    }
    checkSerialCmd();
    checkWifi();
    digitalWrite(LED_BUILTIN, LOW);
  }
  initBLEScan();
}

In the above codes, the scanning time is set to 2 seconds and scan interval 10ms, the tested time before each scan is around 2040ms, therefore the TWDT is set to 3 second - when scan_evt timeout occures, if hangs for more than 3 seconds, the TWDT will reboot the device.
After running this codes over night, it worked!
below are the logs i have captured when the scan_evt timeout happens -
...

<626> Publishing > 0d:b297:0d27:0072
Interval=2064, Scan done! Devices found: 19
<627> Interval=2038, Scan done! Devices found: 24
<628> Interval=2041, Scan done! Devices found: 19
<629> Publishing > 0d:b298:0d23:0074
Interval=2040, Scan done! Devices found: 17
<630> Interval=2040, Scan done! Devices found: 21
<631> Interval=2039, Scan done! Devices found: 21
<632> Publishing > 0d:b299:0d2a:0071
Interval=2071, Scan done! Devices found: 18
scan_evt timeout
<633> E (19766618) task_wdt: Task watchdog got triggered. The following tasks did not reset the watchdog in time:
E (19766618) task_wdt:  - loopTask (CPU 1)
E (19766618) task_wdt: Tasks currently running:
E (19766618) task_wdt: CPU 0: IDLE
E (19766618) task_wdt: CPU 1: IDLE
E (19766618) task_wdt: Aborting.

abort() was called at PC 0x400e33cd on core 0

Backtrace:0x400834dd:0x3ffbe9ac |<-CORRUPTED

ELF file SHA256:<PHONE_NUMBER>000000

Rebooting...
ets Jun  8 2016 00:22:57

rst:0xc (SW_CPU_RESET),boot:0x1b (SPI_FAST_FLASH_BOOT)
configsip: 0, SPIWP:0xee
clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
mode:DIO, clock div:1
load:0x3fff0030,len:1184
load:0x40078000,len:12804
ho 0 tail 12 room 4
load:0x40080400,len:3032
entry 0x400805e4

New bootup [1097BD1A8454]

MQTT - waiting for connection.

Connecting to WiFi .....
MQTT - waiting for connection.
<IP_ADDRESS>
Scan initializing ...
<0> Interval=2018, Scan done! Devices found: 17
<1> Publishing > 0d:b29b:0d21:0072
Interval=2065, Scan done! Devices found: 22
<2> Interval=2049, Scan done! Devices found: 20

...

the entire recovery took about 5s before the ESP32 is up and running again, this walk around is not perfect solution but works for my project.
hope it helps!

Unfortunately, I seem to have the same problem.
My idf version is v4.2 c327a0016eaea7b3fd54fb00a9d88211b70b4643

v4.4.1, have the same problem. BLE/Classic BT + Wifi still unusable in a prod environment.

I had the same problem for months and finally solved it by adjusting the scan interval and scan window. I think the default might be 100/99 which gives very little resources for the ESP to "take out the trash" and "wash the dishes" when you are running a continuous scan like I am.
I changed it to 800/750 and now suddenly the scanner runs and runs without crapping out. Amazing! You can use different numbers I assume, but just be sure to leave some gap between the two numbers so the scanner will take a break and allow the ESP to do some other housekeeping. (I am just speculating that the housekeeping issue is the root of the problem; it might also be that the scanner is overheating or overeating or over somethinging.)
FYI, I had the same problem with the ESP32-WROOM-32U and also with the ESP32-C3. Changing to 800/750 solved it for both of them.

Are you sure it's really solving it and not just making it less likely? Until the root cause for this is analyzed and fixed, I can't really trust the ESP in a production device when it comes to BT.

V4.4.3 has the same problem.

v4.4.4 (via the latest Arduino framework) has the same problem.
My gap between the interval and window is quite wide as per the suggestion by @Zimbu98 - unfortunately this had no effect.


6.0.3 appears broken with unicode fixes

Hello,
Please consider the following scenario:
import ftfy; ftfy.fix_encoding('wei√ü"')

The expected result is 'weiß"'.
This works correctly in 5.6 but breaks with 6.0.3.

On an unrelated note, thank you for this amazing package, ftfy is awesome!

Fixed in 6.1.1. Thanks!


Unable to install plugin

Error: Failed to fetch plugin https://github.com/tomloprod/cordova-plugin-appminimize.git via registry.
Probably this is either a connection problem, or plugin spec is incorrect.
Check your connection and plugin name/version/URL.
Error: cmd: Command failed with exit code<PHONE_NUMBER> Error output:
npm ERR! addLocal Could not install C:\Users\ADUSAR~1\AppData\Local\Temp\npm-29516-a704077a\git-cache-d37c5de6\3c18afce1cebdd6e5f2ba2285aa798d5ef0b6283
npm ERR! Windows_NT 10.0.14393
npm ERR! argv "C:\Program Files\nodejs\node.exe" "C:\Program Files\nodejs\node_modules\npm\bin\npm-cli.js" "install" "https://github.com/tomloprod/cordova-plugin-appminimize.git" "--save"
npm ERR! node v7.2.1
npm ERR! npm  v3.10.10
npm ERR! code EISDIR
npm ERR! errno -4068
npm ERR! syscall read
npm ERR! eisdir EISDIR: illegal operation on a directory, read
npm ERR! eisdir This is most likely not a problem with npm itself
npm ERR! eisdir and is related to npm not being able to find a package.json in
npm ERR! eisdir a package you are trying to install.
npm ERR! Please include the following file with any support request:
npm ERR!     C:\Projects\Amtrak\ionicApp\node_modules\npm-debug.log

Try with:
cordova plugin add cordova-plugin-appminimize


Update dependencies

Update dependencies version
Check for dependencies securities fixes
Use js-function-reflector as npm package instead git link

The git link dependency is breaking my Vercel deployment currently, any chance for a change to that?


[ERROR] import tfdlpack

(dgl-tf) byli@proj55:~/dgl/examples/tensorflow/gcn$ python
Python 3.7.5 (default, Oct 25 2019, 15:51:11)
[GCC 7.3.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.

import dlpack
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'dlpack'
import tfdlpack
Traceback (most recent call last):
File "", line 1, in
File "/home/byli/.conda/envs/dgl-tf/lib/python3.7/site-packages/tfdlpack/init.py", line 2, in
from .core import version, to_dlpack, from_dlpack, get_device_and_dtype
File "/home/byli/.conda/envs/dgl-tf/lib/python3.7/site-packages/tfdlpack/core.py", line 13, in
dlpack_ops = load_library.load_op_library(libinfo.find_lib_path()[0])
File "/home/byli/.conda/envs/dgl-tf/lib/python3.7/site-packages/tensorflow_core/python/framework/load_library.py", line 61, in load_op_library
lib_handle = py_tf.TF_LoadLibrary(library_filename)
tensorflow.python.framework.errors_impl.NotFoundError: /home/byli/.conda/envs/dgl-tf/lib/python3.7/site-packages/tfdlpack/libtfdlpack.so: undefined symbol: _ZN10tensorflow12OpDefBuilder4AttrENSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE

when I import dlpack, I got this error.

What's the version of your tensorflow?

tensorflow-estimator 2.0.1
tensorflow-gpu       2.0.0
tfdlpack-gpu         0.1
Minjie Wang<EMAIL_ADDRESS>于2019年12月12日周四 下午11:15写道：

What's the version of your tensorflow?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/VoVAllen/tf-dlpack/issues/8?email_source=notifications&email_token=AGYIXXUYXZSXVCVPDHG5MTTQYJIRTA5CNFSM4JZ7W2BKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEGW7OVQ#issuecomment-565049174,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AGYIXXR4URFVBD5OEXVPZKDQYJIRTANCNFSM4JZ7W2BA
.

(dgl-tf) byli@proj55:~/.conda/envs/dgl-tf/lib/python3.7/site-packages/tfdlpack$ ldd  /data/home/byli/.conda/envs/dgl-tf/lib/python3.7/site-packages/tfdlpack/libtfdlpack.so
linux-vdso.so.1 (0x00007ffeda526000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007faf17db8000)
libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007faf17bb4000)
librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007faf179ac000)
libtensorflow_framework.so.2 => not found
libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007faf17623000)
libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007faf1740b000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007faf1701a000)
/lib64/ld-linux-x86-64.so.2 (0x00007faf18269000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007faf16c7c000)

I change the LD_LIBRARY_PATH, and now libtensorflow_framework.so.2 is found. But the error still occurs.

@curiosityyy The problem should be fixed in #9 and a new release v0.1.1 has been pushed. Please upgrade tfdlpack and let us know if anything is wrong.

Thanks. Now it works.

This problem occurs with v0.1.3, anyway solved by reinstalling tensorflow with pip rather than conda.

@kimjh12 dlpack is now supported in the official tensorflow. You can get it by tf.experimental.dlpack.to_dlpack/from_dlpack. I suggest using the latest nightly build, or at least 2.2 version.