[Emoji Search app] Sample is not working

I have run the Emoji search app ,  but changing compose view on Emoji Search on presenter logic is not reflecting on android/ios app ui. while server is running perfectly and able to detect changes, rebuild.
there is open issue - https://github.com/cashapp/redwood/issues/1820 is it linked with this?
is it not stable library ?

Yes, this behavior is tracked by that issue. You can comment-out the build.gradle line which declares the embedded application if you want to do hot reloading. There is no timeline on for the fix–it's in an upstream library so it's out of our control. This doesn't affect the behavior of release builds so it's not a huge priority.

@JakeWharton But without can't we use this library for production app, as it seems network cache also not working, it always making calls to server and fetching screen data..
any suggestion here?

I don't believe we have a network cache setup for Emoji, as it's primarily a development sample. In our production app we only use a network cache. I will have to check tomorrow.

@JakeWharton How we can enable/setup network cache while using treehouse library.
We are thinking of using in production app, we can't go without network cache.
Please help

@JakeWharton Please suggest

We have not, because nothing else really provides the capabilities that we're after.
Is Treehouse slower than just using native UI–absolutely. It always will be. We work really hard on making the performance the best it can be given the capabilities that we want to offer. Being able to deliver layout changes to millions of users in under an hour rather than it taking two weeks is worth a slight hit on performance. These also aren't our most performance-sensitive screens in the app–those are still entirely native.

You have to set it up for each platform, but it has a default that should make it work automatically.
Android: https://github.com/cashapp/redwood/blob/trunk/redwood-treehouse-host/src/androidMain/kotlin/app/cash/redwood/treehouse/treehouseAppFactoryAndroid.kt#L36-L37
iOS: https://github.com/cashapp/redwood/blob/trunk/redwood-treehouse-host/src/iosMain/kotlin/app/cash/redwood/treehouse/treehouseAppFactoryIos.kt#L33-L34

@JakeWharton We already have design system , can we use compose multiplatform directly without using redwood and getting  advantage of update UI on the fly like server driven approach?
does protocol system work independently or we have to use redwood?

That is correct, yes.

@JakeWharton as you guys already shipped the cash app with tree house.. can you open source basic widget component of redwood composable like TextView, Button,Toolbar etc..
I hope you have developed these things already and will be helpful for us (not repeating the same thing)

No, because it's specific to our design system and is not customizable. You can look at the basic schemas for our samples or the test app, and #2275 will offer a basic, blueprint-like set to experiment with. Part of the point is that we do not want to be prescriptive about how granular or coarse your design system schema is built. It's entirely up to you.


Is it possible to plot the lines of code of a user-customized directory/directories along with the lines of code of the whole project?

I wonder it is possible to plot the lines of code of a user-customized directory/directories along with the lines of code of the whole project?
Sometimes, in addition to the lines of code of a project, we also want to know a specific directory's lines of code trends.

https://github.com/lsk569937453/git-statistic/pull/16
This issue has been completed in the above pr.

Thank you for your effort.
In the plots by directories, could you please also add the root directory (the total lines of the project)?
BTW, there is a possible bug in current implementation. After plots by directories are drawn, when we switch to other tabs then switch back, the plots by directories have gone. We expect that the plots stay there.

Thank you for your effort.
In the plots by directories, could you please also add the root directory (the total lines of the project)? I think we could keep only one plot there, not two.
BTW, there is a possible bug in current implementation. After plots by directories are drawn, when we switch to other tabs then switch back, the plots by directories have gone. We expect that the plots stay there.

Thank you for your feedback and suggestions!
Root Directory Plot: I agree that including the root directory's total lines in the plot will provide a more comprehensive view of the project. I will ensure that the root directory is added, and we will consolidate it into one plot instead of two, as per your suggestion.
Bug with Plot Visibility: I have noted the bug regarding the plots disappearing when switching tabs. I'll investigate this and implement a fix in the next release to ensure the plots remain visible after switching between tabs.
Both of these improvements will be included in the upcoming release. Thank you again for your valuable input!

One more question, during the initial stage of selecting a git repo, does the appliation store the analyzing result into a database, say SQLite db, and then retrieve the result from the DB when we switch to the functional tabs?

Yes, that's correct! After the user selects a repository, the application performs an analysis on the repo and stores the statistical results in an SQLite database. When the user switches between tabs, the application retrieves the relevant data from the SQLite database to display on the web page.

One more question, during the initial stage of selecting a git repo, does the appliation store the analyzing result into a database, say SQLite db, and then retrieve the result from the DB when we switch to the functional tabs?

The problem has been fix in https://github.com/lsk569937453/git-statistic/pull/22.

Thank you for your persistent dedication.


Internal access declaration

Move declaration of the internal_access signal to remove access before declaration issues.

CHANGE AUTHORIZED: hw/ip/tlul/rtl/tlul_adapter_vh.sv


Add support for amperage hotplug

https://github.com/frap129/SHAMU-kernel/commit/01374be6752b24e2c3700b2cd090630ff92763ee

Requestor changed his mind about this for now.


[BUG] UCX Shuffle With scala.MatchError

When I use UCX mode to accelerate Spark on GPU, I encounter a "MatchError" in the final step. I have tested that UCX runs normally, and the multithread mode works fine as well. How should I address this issue? Thank you.
prod env:
UCX: Library version: 1.17.0
spark: 3.5.1(scala 2.13)
rapids: rapids-4-spark_2.13-24.06.0.jar
UCX Params:
spark.shuffle.manager=com.nvidia.spark.rapids.spark351.RapidsShuffleManager
spark.rapids.shuffle.mode=UCX
spark.shuffle.service.enabled=false
spark.dynamicAllocation.enabled=false
spark.executor.extraClassPath=hdfs:///data/libs/spark3_5_1_a1/rapids-4-spark_2.13-24.06.0-SNAPSHOT-cuda11.jar
spark.executorEnv.UCX_ERROR_SIGNALS=
spark.executorEnv.UCX_MEMTYPE_CACHE=n
spark.executorEnv.UCX_IB_RX_QUEUE_LEN=1024
spark.executorEnv.UCX_TLS=cuda_copy,cuda_ipc,rc,tcp
spark.executorEnv.UCX_RNDV_SCHEME=put_zcopy
spark.executorEnv.UCX_MAX_RNDV_RAILS=1
spark.rapids.memory.host.spillStorageSize=2G
Error log:
4/06/27 07:25:57 INFO MapOutputTrackerWorker: Updating epoch to 1 and clearing cache
24/06/27 07:25:57 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB)
24/06/27 07:25:57 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 7.9 KiB, free 23.8 GiB)
24/06/27 07:25:57 INFO TorrentBroadcast: Reading broadcast variable 2 took 6 ms
24/06/27 07:25:57 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 21.3 KiB, free 23.8 GiB)
24/06/27 07:25:57 INFO RapidsShuffleInternalManagerBase: Asking map output tracker for dependency GPU Shuffle Dependency, map output sizes for: 0, parts=0-1
24/06/27 07:25:57 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 0, fetching them
24/06/27 07:25:57 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@ip-10-12-4-15.tj.testlab.co:13939)
24/06/27 07:25:57 INFO MapOutputTrackerWorker: Got the map output locations
24/06/27 07:25:57 INFO RapidsCachingReader: Will read 8 cached blocks, 5 remote blocks from the RapidsShuffleTransport.
24/06/27 07:25:58 INFO CodeGenerator: Code generated in 217.860412 ms
24/06/27 07:25:58 INFO RapidsShuffleIterator: Fetching 5 blocks.
24/06/27 07:25:58 WARN RapidsShuffleIterator: Iterator for task 45 closing, but it is not done. Closing 0 resolved batches!!
24/06/27 07:25:58 ERROR Executor: Exception in task 0.2 in stage 2.0 (TID 45)
scala.MatchError: (BlockManagerId(6, ip-10-12-4-29.tj.testlab.co, 10679, Some(rapids=28687)),ListBuffer((shuffle_0_19_0,66,5), (shuffle_0_25_0,66,11), (shuffle_0_31_0,66,17), (shuffle_0_37_0,66,23), (shuffle_0_5_0,66,31), (shuffle_0_11_0,66,37))) (of class scala.Tuple2)
at com.nvidia.spark.rapids.shuffle.RapidsShuffleIterator.$anonfun$start$3(RapidsShuffleIterator.scala:175)
at com.nvidia.spark.rapids.shuffle.RapidsShuffleIterator.$anonfun$start$3$adapted(RapidsShuffleIterator.scala:175)
at scala.collection.ArrayOps$.foreach$extension(ArrayOps.scala:1328)
at com.nvidia.spark.rapids.shuffle.RapidsShuffleIterator.start(RapidsShuffleIterator.scala:175)
at com.nvidia.spark.rapids.shuffle.RapidsShuffleIterator.next(RapidsShuffleIterator.scala:357)
at com.nvidia.spark.rapids.shuffle.RapidsShuffleIterator.next(RapidsShuffleIterator.scala:63)
at scala.collection.Iterator$$anon$9.next(Iterator.scala:577)
at scala.collection.Iterator$ConcatIterator.next(Iterator.scala:1187)
at org.apache.spark.util.CompletionIterator.next(CompletionIterator.scala:29)
at org.apache.spark.InterruptibleIterator.next(InterruptibleIterator.scala:40)
at scala.collection.Iterator$$anon$9.next(Iterator.scala:577)
at com.nvidia.spark.rapids.CollectTimeIterator.$anonfun$next$1(GpuExec.scala:200)
at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
at com.nvidia.spark.rapids.CollectTimeIterator.next(GpuExec.scala:199)
at com.nvidia.spark.rapids.AbstractGpuCoalesceIterator.populateCandidateBatches(GpuCoalesceBatches.scala:458)
at com.nvidia.spark.rapids.AbstractGpuCoalesceIterator.$anonfun$next$1(GpuCoalesceBatches.scala:620)
at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
at com.nvidia.spark.rapids.AbstractGpuCoalesceIterator.next(GpuCoalesceBatches.scala:600)
at com.nvidia.spark.rapids.AbstractGpuCoalesceIterator.next(GpuCoalesceBatches.scala:250)
at com.nvidia.spark.rapids.AbstractProjectSplitIterator.next(basicPhysicalOperators.scala:247)
at com.nvidia.spark.rapids.AbstractProjectSplitIterator.next(basicPhysicalOperators.scala:227)
at scala.collection.Iterator$$anon$9.next(Iterator.scala:577)
at scala.collection.Iterator$$anon$9.next(Iterator.scala:577)
at scala.collection.Iterator$$anon$10.nextCur(Iterator.scala:587)
at scala.collection.Iterator$$anon$10.hasNext(Iterator.scala:601)
at scala.collection.Iterator$$anon$9.hasNext(Iterator.scala:576)
at com.nvidia.spark.rapids.GpuMergeAggregateIterator.$anonfun$next$2(GpuAggregateExec.scala:751)
at scala.Option.getOrElse(Option.scala:201)
at com.nvidia.spark.rapids.GpuMergeAggregateIterator.next(GpuAggregateExec.scala:749)
at com.nvidia.spark.rapids.GpuMergeAggregateIterator.next(GpuAggregateExec.scala:711)
at scala.collection.Iterator$$anon$9.next(Iterator.scala:577)
at com.nvidia.spark.rapids.DynamicGpuPartialSortAggregateIterator.$anonfun$next$6(GpuAggregateExec.scala:2042)
at scala.Option.map(Option.scala:242)
at com.nvidia.spark.rapids.DynamicGpuPartialSortAggregateIterator.next(GpuAggregateExec.scala:2042)
at com.nvidia.spark.rapids.DynamicGpuPartialSortAggregateIterator.next(GpuAggregateExec.scala:1906)
at com.nvidia.spark.rapids.ColumnarToRowIterator.$anonfun$fetchNextBatch$3(GpuColumnarToRowExec.scala:290)
at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
at com.nvidia.spark.rapids.ColumnarToRowIterator.fetchNextBatch(GpuColumnarToRowExec.scala:287)
at com.nvidia.spark.rapids.ColumnarToRowIterator.loadNextBatch(GpuColumnarToRowExec.scala:257)
at com.nvidia.spark.rapids.ColumnarToRowIterator.hasNext(GpuColumnarToRowExec.scala:304)
at scala.collection.Iterator$$anon$9.hasNext(Iterator.scala:576)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$getByteArrayRdd$1(SparkPlan.scala:388)
at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsInternal$2(RDD.scala:893)
at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsInternal$2$adapted(RDD.scala:893)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:367)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:331)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:93)
at org.apache.spark.TaskContext.runTaskWithListeners(TaskContext.scala:166)
at org.apache.spark.scheduler.Task.run(Task.scala:141)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$4(Executor.scala:620)
at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally(SparkErrorUtils.scala:64)
at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally$(SparkErrorUtils.scala:61)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:94)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:623)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
24/06/27 07:25:59 INFO UCX: Got UcpListener request from /<IP_ADDRESS>:49394
24/06/27 07:25:59 INFO UCX: Created ConnectionRequest endpoint UcpEndpoint(id=140288598057472, UcpEndpointParams{errorHandlingMode=UCP_ERR_HANDLING_MODE_PEER,connectionRequest/<IP_ADDRESS>:49394) for /<IP_ADDRESS>:49394
24/06/27 07:25:59 INFO UCX: Success sending handshake header! java.nio.DirectByteBuffer[pos=0 lim=281 cap=281]
24/06/27 07:25:59 INFO UCX: Established endpoint on ConnectionRequest for executor 8: UcpEndpoint(id=140288598057472, UcpEndpointParams{errorHandlingMode=UCP_ERR_HANDLING_MODE_PEER,connectionRequest/<IP_ADDRESS>:49394)
24/06/27 07:26:02 INFO RapidsShuffleHeartbeatEndpoint: Updating shuffle manager for new executor BlockManagerId(8, ip-10-12-5-23.tj.testlab.co, 35905, Some(rapids=1144))
24/06/27 07:26:02 INFO UCX: Creating connection for executorId 8
24/06/27 07:26:02 INFO UCXClientConnection: UCX Client UCXClientConnection(ucx=com.nvidia.spark.rapids.shuffle.ucx.UCX@31f2b220, peerExecutorId=8) started
24/06/27 07:26:02 INFO RapidsShuffleHeartbeatEndpoint: Updating shuffle manager for new executor BlockManagerId(4, ip-10-12-5-23.tj.testlab.co, 25369, Some(rapids=59993))
24/06/27 07:26:02 INFO UCX: Creating connection for executorId 4
24/06/27 07:26:02 INFO UCXClientConnection: UCX Client UCXClientConnection(ucx=com.nvidia.spark.rapids.shuffle.ucx.UCX@31f2b220, peerExecutorId=4) started
@gerashegalov

@KevinLu233 this is an odd place to have a failure:

(BlockManagerId(6, ip-10-12-4-29.tj.testlab.co, 10679, Some(rapids=28687)),ListBuffer((shuffle_0_19_0,66,5), (shuffle_0_25_0,66,11), (shuffle_0_31_0,66,17), (shuffle_0_37_0,66,23), (shuffle_0_5_0,66,31), (shuffle_0_11_0,66,37))) (of class scala.Tuple2)

It seems to not match:

case (blockManagerId: BlockManagerId, blockIds: Seq[(BlockId, Long, Int)])

This looks like a class mismatch: the spark the was used to build the spark-rapids plugin 3.5.1 shim and corresponding shuffle manager isn't what is running in the executor.
I ran a test locally against spark 3.5.1 as released using the released spark-rapids from https://mvnrepository.com/artifact/com.nvidia/rapids-4-spark_2.13/24.06.0, and I don't see the issue locally.
A few questions:

The jar hdfs:///data/libs/spark3_5_1_a1/rapids-4-spark_2.13-24.06.0-SNAPSHOT-cuda11.jar: is that the same jar you are using to submit the job?
Is the spark 3.5.1 running in the driver and executor the same exact version?
Did you build the snapshot with the same spark distro that is running in the driver/executors?
Please try to repro against the released versions of spark and spark-rapids.

Thanks!

This is caused by scala2.13 @abellina
Discussions in scala communicity: https://users.scala-lang.org/t/change-in-varargs-in-scala-2-13/5731
And this is a simple code to replay this error in scala 2.13
import scala.collection.mutable.ListBuffer

object Test {
  def main(args: Array[String]): Unit = {
    val data = Array.fill(10) { (math.random(), ListBuffer.fill(1)(math.random())) }
    val (l, r) = data.partition(a => a._1 > 0.5)
    (l ++ r).foreach { case (v1: Double, v2: Seq[Double]) =>
      println(v1, v2)
    }
  }
}

This patch could solve this error
diff --git a/sql-plugin/src/main/spark340/scala/com/nvidia/spark/rapids/shuffle/RapidsShuffleIterator.scala b/sql-plugin/src/main/spark340/scala/com/nvidia/spark/rapids/shuffle/RapidsShuffleIterator.scala
index 29f36d6f2..72c1f935e 100644
--- a/sql-plugin/src/main/spark340/scala/com/nvidia/spark/rapids/shuffle/RapidsShuffleIterator.scala
+++ b/sql-plugin/src/main/spark340/scala/com/nvidia/spark/rapids/shuffle/RapidsShuffleIterator.scala
@@ -173,7 +173,7 @@ class RapidsShuffleIterator(
     val (local, remote) = blocksByAddress.partition(ba => ba._1.host == localHost)

     (local ++ remote).foreach {
-      case (blockManagerId: BlockManagerId, blockIds: Seq[(BlockId, Long, Int)]) => {
+      case (blockManagerId: BlockManagerId, blockIds: collection.Seq[(BlockId, Long, Int)]) => {
         val shuffleRequestsMapIndex: Seq[BlockIdMapIndex] =
           blockIds.map { case (blockId, _, mapIndex) =>
             /**
@@ -193,7 +193,7 @@ class RapidsShuffleIterator(
                 throw new IllegalArgumentException(
                   s"${blockId.getClass} $blockId is not currently supported")
             }
-          }
+          }.toSeq

         val client = try {
           transport.makeClient(blockManagerId)

@xieshuaihu thank you!!!! yes, I did not run with scala 2.13 here and neither did our tests, and sorry I didn't realize this was 2.13 though you clearly called it out in the issue description.
We'll work on incorporating your patch and to run scala 2.13 testing as well.

@xieshuaihu I have run with your patch locally and I am able to pass tests, so I would like to get this change into the codebase. Would you like to create a PR with the change as is, rather than me adopting your change as it works verbatim.
The requirement for PRs is that you sign your commits as outlined here https://github.com/NVIDIA/spark-rapids/blob/branch-24.08/CONTRIBUTING.md#sign-your-work (via git commit -s), and it certifies you agree with the "Developer Certificate of Origin".
I encourage you to make the change and I'll be happy to review it. Let us know!

@abellina Thanks your suggestion. A pr will be submitted on monday


how is the database app ( create database ... ) firstly created ?

Hi there,
I have been taking a look at the generated code/scripts/etc for a while now, and was wondering how is that the database app is firstly created ?  It would seem the code and scripts regarding initialisation would expect for app to be there already if I am not mistaken ? Does it have to be created manually ? I didn't find a reference to this part within the README file.
I did run the project and was able to see it working, but it was a while back and I don't remember if I had instinctively (and blindly/automatically) created the database myself without paying too much attention to this step.
Thanks in avance.

alembic :)
somewhere around here:
https://github.com/tiangolo/full-stack-fastapi-postgresql/blob/490c554e23343eec0736b06e59b2108fdd057fdc/{{cookiecutter.project_slug}}/backend/app/app/db/init_db.py#L12

hi @haviduck , thanks for your response. But you are talking about the schema/tables. I was talking about the database itself (note that alembic will error if the database is not created beforehand)
also, the code you pointed out not only assumes the database is created but the tables as well.

for future readers: the postgres container image will create the database ( POSTGRES_DB ) when first started:

POSTGRES_DB
This optional environment variable can be used to define a different name for the default database that is created when the image is first started. If it is not specified, then the value of POSTGRES_USER will be used.

which it is being passed through the .env file:
  db:
    image: postgres:12
    volumes:
      - app-db-data:/var/lib/postgresql/data/pgdata
    env_file:
      - .env

Thanks for the help here @haviduck ! 👏  🙇
Thanks for reporting back and closing the issue @gerazenobi  👍

Sorry for the long delay! 🙈  I wanted to personally address each issue/PR and they piled up through time, but now I'm checking each one in order.


Fixes #1090

Add link for documentation published by rubygems in README
Remove rake task to generate YARD docs

Needs changelog please, also remove yard from Gemfile (and elsewhere?)

Done

Thanks


Limits 10 Concurrent connections

Seems to have a limit of 10 connections for windows 10.
I think in windows 7 I was able to do more 10 connections. Any way to remove the limit?

This depends on hardware, redirecting you to issue #192 (your situation is the same).


for encrypt bug

Fixes #ISSUSE_ID.
Changes proposed in this pull request:

Pull Request Test Coverage Report for Build 6990

0 of 0   changed or added relevant lines in 0 files are covered.
9 unchanged lines in 3 files lost coverage.
Overall coverage increased (+0.09%) to 71.217%

Files with Coverage Reduction
New Missed Lines
%

sharding-core/src/main/java/org/apache/shardingsphere/core/parsing/antlr/filler/sharding/statement/impl/dml/UpdateSetWhereFiller.java
1
90.0%

sharding-core/src/main/java/org/apache/shardingsphere/core/parsing/antlr/filler/encrypt/segment/impl/EncryptUpdateSetWhereFiller.java
1
0.0%

sharding-proxy/sharding-proxy-backend/src/main/java/org/apache/shardingsphere/shardingproxy/backend/communication/jdbc/datasource/JDBCBackendDataSource.java
7
64.0%

Totals

Change from base Build 6989:
0.09%

Covered Lines:
11315

Relevant Lines:
15888

💛  - Coveralls


Minor refactoring on NuageLoad

Coverage remained the same at 0.0% when pulling 29b799251475b298b67f256835da6b3b3acce285 on alyiwang:linkedin into 290f925cd12109d03064789d11c0a0ec794f0c33 on linkedin:linkedin.


Solid wrapper

Adds a package for Solid-JS support. Also includes docs for it.

Closes: #429.

@LiamMartens thank you for your great contribution 🎉. I have a lot in the pipe now before I can review this PR so thank you for your patience.
Best,
David

@LiamMartens I have a little left to test on this PR and I want to let you know that this is great! I will make some small adjustments to align some things with the other existing wrappers like React, Vue and Svelte.
Soon Embla will have a SolidJS wrapper published 🎉. I want to put your name on the SolidJS wrapper if that’s ok?

Awesome thanks for having a look and merging! @davidjerleke


ng-snotify changes DOM all the time

When I run my application and open Chrome DevTools, I can see that DOM elements inside ng-snotify components are being refreshed all the time.
It depends on which part of the application I am in. In some parts snotify DOM elements are refreshed on every click. In other parts they are constantly being refreshed even if I am not doing anything. It probably means that they are refreshed on every changed detection cycle.
I think one problem is caused by SnotifyService emitting events all the time even if you do not have any notifications open in your application.
The other problem is not using trackBy function in SnotifyComponent. Otherwise, it would not be refreshed even though SnotifyService kept emitting new events.

I noticed this in the element inspector. Maybe it's intended behavior?

@tatsujb How can it be intended behaviour? The library clearly cannot work properly together with Angular change detection.

same here. +1


feat: useDeprecatedOperations to exclude deprecated (#564)

Status
*READY
Description
Adds new useDeprecatedOperations option to allow excluding deprecated operations from even being generated in the code!
Adding this to config will stop them from being generated the value is true by default to not change any existing behavior.
module.exports = {
  petstore: {
    output: {
      override: {
        useDeprecatedOperations: false,
      },
    },
  },
};

OK I was able to get it all working.

OK I added to angular and swr generators too.  Until the V7 overhaul I would still love to see this feature in 6.9.7 only because I have an API with a lot of deprecated methods and its generating so much TypeScript code I don't want the UI developers to see or use.

Would be better to do it here no?

  PR updated that was a MUCH better place for it. Way cleaner and really what I wanted to do in the first place.


Change scheduleUpdate interval outside constructor?

First, a few things...

[ ] Is your feature request related to a problem?
[X] Will this feature just help you or is it something everyone needs?
[ ] Have you tried to implement or draft this feature?
[ ] Is your feature a breaking change?

😄 Describe the solution you'd like
Is it possible on the current v2.5.4-rc.1 version to change the interval of a already running scheduleUpdate task?
I'm making some sort of animation with keyframes, and i wanted to make it so every keyframe has its specific time until next update.
🧠 Describe alternatives you've considered
I've considered calling another scheduleUpdate even if there is a current one. But i've not tested this.
🤚 Drawbacks
No response
💻 Platform

[X] Bukkit
[ ] Sponge
[ ] Other
[ ] All

⭐ Version
v2.5.4-rc.1
✍ Additional context
No response

Nvm, i already implemented my own ticks until next keyframe system, but that would be a good feature for IF.

Planned to v3.0.0-RC.1


Update apple-notes extension

Description

The new note created by the AI Note command is now instantly displayed for immediate editing.
Fixed npm audit issues by regeneratingpackage-lock.json.

Checklist

[x] I read the extension guidelines
[x] I read the documentation about publishing
[x] I ran npm run build and tested this distribution build in Raycast
[x] I checked that files in the assets folder are used by the extension itself
[x] I checked that assets used by the README are placed outside of the metadata folder

Thanks for the PR! I took the opportunity to remove useless assets files.


Community Page - Overflow

Current behaviour

Expected behaviour

Fix the sizing of the community section in the navbar such that it doesn't overlaps with the text.

Reproduction steps
1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error

Screenshots

Browsers
Chrome
OS
Windows
Are you contributing for a program ?
Other
Checklist

[X] I have checked the existing issues
[X] I have read the Contributing Guidelines
[X] I am willing to work on this issue (optional)
[X] I am a GSSoC'23 contributor

It's a very beginner friendly issue so I will assign it to the person who comments first 👍

please assign this to me, ill fix that


Clarify rationale for posting generic FLOSS license

Documentation says:

The project MUST post license(s) in a standard location.

Is this really required for generic FLOSS license?
In my case, our project produces an NPM package, and the MIT license is declared in package.json. FLOSS licenses are available online in various places already;
what is the rationale for requiring the additional disk space be wasted (per package)
in this case? The R Project recommends package authors not waste space with
YA copy of GPL (if unnecessary) for exactly this reason.

IIRC, there are several rationales:

Ensure that the license really does apply to the software
Make it easy for a potential user to determine what his rights are
Make it easy for external software to determine the license.
Make the license text frozen even if websites disappear.

I think some lawyers are worried that if the license is external, it might be argued that a different license will apply than what was intended.  Of course, with the presence of packaging mechanisms, SPDX, and OSI, that concern may be overblown.
I think disk space is a moot argument today; git stores copies of every version with no drama.
Of course, perhaps it could be argued that putting the license reference in package.json is posting the license in a standard location, if it's obvious that the "mit" entry in package.json must refer to exactly one license (which one?).  If we allow that, then we'd better document that... and make it clear what cases apply.  But how can we make sure that the license will be understood if some web sites disappear?  How can we be sure it's a "standard location"?

@david-a-wheeler, thanks for your thoughts on this issue. One means around that would be for this site to include standard licenses that could be referenced if you don't trust other sources. Think that's a waste myself, but... Disagree that disk space is an issue; having one copy of a 1K document is one thing, but how many NPM packages are there? Someone is paying for that space, and believe wasting it (with reference copies of publicly available LICENSE text) is a crime.
Far simpler to reference OSI's version (or whatever is deemed appropriate) ...

I looked at the referenced page on licensing R extensions, and it doesn't really support this argument.  It instead says:
"Whereas you should feel free to include a license file in your source distribution, please do not arrange to install yet another copy of the GNU COPYING or COPYING.LIB files but refer to the copies on https://www.R-project.org/Licenses/ and included in the R distribution (in directory share/licenses). Since files named LICENSE or LICENCE will be installed, do not use these names for standard license files. To include comments about the licensing rather than the body of a license, use a file named something like LICENSE.note."
Please notice that we're concerned about the source distribution.  It's fine if the installer doesn't install another copy at install-time, the criterion doesn't require installation of a license file at install time.
From a legal perspective it is much easier to enforce a license if it is included in the distribution of the (source) software package.  And given disk space and network speed today, the license files are not a big deal.  What's more, if you refer to anything external, there's no guarantee it will exist forever, and certainly no guarantee that no one will manipulate it.
I think things are better as-is.  Thanks for your feedback!


⚠ ClamAV has degraded performance

In 4056ad3, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 74 ms

Resolved: ClamAV performance has improved in c2fd8b5.


Mount system-probe.yaml in the process-agent container when enabled

Is this a new chart

NOTE: We're experiencing a high volume of PRs to this repo and reviews will be delayed. Please host your own chart repository and submit your repository to the Helm Hub instead of this repo to make them discoverable to the community. Here is how to submit new chart repositories to the Helm Hub.

What this PR does / why we need it:
https://github.com/helm/charts/pull/22686/files changed the location of
the system-probe socket away from the default.
Since the process-agent was relying on the socket being at the default
location by dint of not having the system-probe.yaml file, this commit
broke the process-agent -> system-probe communication.
Which issue this PR fixes
Special notes for your reviewer:
Checklist
[Place an '[x]' (no spaces) in all applicable fields. Please remove unrelated fields.]

[ ] DCO signed
[ ] Chart Version bumped
[ ] Variables are documented in the README.md
[ ] Title of the PR starts with chart name (e.g. [stable/mychartname])

/ok-to-test

/lgtm


DocsArchive-<IP_ADDRESS>Auto archive content

Please don't merge this PR until target archive repo PR https://github.com/OPS-E2E-PPE/docs-yml-archive-non-versioning-archive/pull/78 is merged into live branch.
Auto archive content to https://github.com/VSC-Service-Account/docs-yml-archive-non-versioning-archive.git

Docs Build status updates of commit 6e7431b:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

.openpublishing.redirection.json
:white_check_mark:Succeeded

docs/TOC.yml
:white_check_mark:Succeeded
View

docs/to-be-archive/level1/article3-1-1.md
:white_check_mark:Succeeded
View

docs/to-be-archive/level1/article3-1-2.md
:white_check_mark:Succeeded
View

docs/to-be-archive/level1/article3-1-3.yml
:white_check_mark:Succeeded
View

docs/to-be-archive/level2/article3-2-1.md
:white_check_mark:Succeeded
View

docs/to-be-archive/level2/article3-2-2.md
:white_check_mark:Succeeded
View

docs/to-be-archive/level2/article3-2-3.yml
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 6e7431b:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

.openpublishing.redirection.json
:white_check_mark:Succeeded

docs/TOC.yml
:white_check_mark:Succeeded
View

docs/to-be-archive/level1/article3-1-1.md
:white_check_mark:Succeeded
View

docs/to-be-archive/level1/article3-1-2.md
:white_check_mark:Succeeded
View

docs/to-be-archive/level1/article3-1-3.yml
:white_check_mark:Succeeded
View

docs/to-be-archive/level2/article3-2-1.md
:white_check_mark:Succeeded
View

docs/to-be-archive/level2/article3-2-2.md
:white_check_mark:Succeeded
View

docs/to-be-archive/level2/article3-2-3.yml
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


Bug report: reinstall logitech-control-center fails

Cannot uninstall or reinstall logitech-control-center
I'm on macOS 10.12.3 (16D32).
Both "reinstall" and "uninstall" result in the same error:
`brew cask uninstall logitech-control-center --verbose`
==> Downloading https://www.logitech.com/pub/techsupport/mouse/mac/lcc<IP_ADDRESS>.zip
Already downloaded: /Users/sheim/Library/Caches/Homebrew/Cask/logitech-control-center--<IP_ADDRESS>.zip
==> Verifying checksum for Cask logitech-control-center
==> Running uninstall process for logitech-control-center; your password may be necessary
==> Running uninstall script LCC Installer.app/Contents/Resources/LCC Uninstaller Tool
==> 2017-03-14 15:41:50.249 LCC Uninstaller Tool[7986:123550] Running LCC Uninstall tool. Arguments = (
==>     "/usr/local/Caskroom/logitech-control-center/<IP_ADDRESS>/LCC Installer.app/Contents/Resources/LCC Uninstaller Tool"
==> )
==> Uninstalling packages:
com.Logitech.Control Center.pkg
Error: incompatible encoding regexp match (UTF-8 regexp with ASCII-8BIT string)
Follow the instructions here:
  https://github.com/caskroom/homebrew-cask/blob/master/doc/reporting_bugs/pre_bug_report.md

If this doesn’t fix the problem, please report this bug:
  https://github.com/caskroom/homebrew-cask#reporting-bugs

/usr/local/Homebrew/Library/Homebrew/vendor/plist/plist/parser.rb:91:in `scan'
/usr/local/Homebrew/Library/Homebrew/vendor/plist/plist/parser.rb:91:in `parse'
/usr/local/Homebrew/Library/Homebrew/vendor/plist/plist/parser.rb:29:in `parse_xml'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/system_command.rb:160:in `_parse_plist'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/system_command.rb:131:in `plist'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/pkg.rb:75:in `info'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/pkg.rb:66:in `pkgutil_bom_all'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/pkg.rb:54:in `pkgutil_bom_files'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/pkg.rb:17:in `uninstall'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/artifact/uninstall_base.rb:191:in `block (2 levels) in uninstall_pkgutil'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/artifact/uninstall_base.rb:189:in `each'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/artifact/uninstall_base.rb:189:in `block in uninstall_pkgutil'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/artifact/uninstall_base.rb:188:in `each'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/artifact/uninstall_base.rb:188:in `uninstall_pkgutil'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/artifact/uninstall_base.rb:34:in `block (2 levels) in dispatch_uninstall_directives'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/artifact/uninstall_base.rb:32:in `each'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/artifact/uninstall_base.rb:32:in `block in dispatch_uninstall_directives'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/artifact/uninstall_base.rb:31:in `each'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/artifact/uninstall_base.rb:31:in `dispatch_uninstall_directives'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/artifact/uninstall.rb:7:in `uninstall_phase'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/installer.rb:330:in `block in uninstall_artifacts'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/installer.rb:327:in `each'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/installer.rb:327:in `uninstall_artifacts'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/installer.rb:312:in `uninstall'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/cli/reinstall.rb:27:in `block in install_casks'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/cli/reinstall.rb:6:in `each'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/cli/reinstall.rb:6:in `install_casks'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/cli/install.rb:10:in `run'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/cli.rb:114:in `run_command'
/usr/local/Homebrew/Library/Homebrew/cask/lib/hbc/cli.rb:157:in `process'
/usr/local/Homebrew/Library/Homebrew/cmd/cask.rb:8:in `cask'
/usr/local/Homebrew/Library/Homebrew/brew.rb:91:in `<main>'
Error: Kernel.exit

Output of `brew doctor`
Please note that these warnings are just used to help the Homebrew maintainers
with debugging if you file an issue. If everything you use Homebrew for is
working fine: please don't worry and just ignore them. Thanks!

Warning: Unbrewed dylibs were found in /usr/local/lib.
If you didn't put them there on purpose they could cause problems when
building Homebrew formulae, and may need to be deleted.

Unexpected dylibs:
  /usr/local/lib/libgepetto-viewer-corba.dylib
  /usr/local/lib/libgepetto-viewer.dylib
  /usr/local/lib/libosgQt.3.5.5.dylib

Warning: Unbrewed header files were found in /usr/local/include.
If you didn't put them there on purpose they could cause problems when
building Homebrew formulae, and may need to be deleted.

Unexpected header files:
  /usr/local/include/gepetto/viewer/blender-geom-writer.h
  /usr/local/include/gepetto/viewer/config-osg.h
  /usr/local/include/gepetto/viewer/config.h
  /usr/local/include/gepetto/viewer/group-node.h
  /usr/local/include/gepetto/viewer/leaf-node-arrow.h
  /usr/local/include/gepetto/viewer/leaf-node-box.h
  /usr/local/include/gepetto/viewer/leaf-node-capsule.h
  /usr/local/include/gepetto/viewer/leaf-node-collada.h
  /usr/local/include/gepetto/viewer/leaf-node-cone.h
  /usr/local/include/gepetto/viewer/leaf-node-cylinder.h
  /usr/local/include/gepetto/viewer/leaf-node-face.h
  /usr/local/include/gepetto/viewer/leaf-node-ground.h
  /usr/local/include/gepetto/viewer/leaf-node-light.h
  /usr/local/include/gepetto/viewer/leaf-node-line.h
  /usr/local/include/gepetto/viewer/leaf-node-mesh.h
  /usr/local/include/gepetto/viewer/leaf-node-sphere.h
  /usr/local/include/gepetto/viewer/leaf-node-xyzaxis.h
  /usr/local/include/gepetto/viewer/macros.h
  /usr/local/include/gepetto/viewer/node-rod.h
  /usr/local/include/gepetto/viewer/node-visitor.h
  /usr/local/include/gepetto/viewer/node.h
  /usr/local/include/gepetto/viewer/OSGManipulator/keyboard-manipulator.h
  /usr/local/include/gepetto/viewer/roadmap-viewer.h
  /usr/local/include/gepetto/viewer/transform-writer.h
  /usr/local/include/gepetto/viewer/urdf-parser.h
  /usr/local/include/gepetto/viewer/window-manager.h

Warning: Unbrewed .pc files were found in /usr/local/lib/pkgconfig.
If you didn't put them there on purpose they could cause problems when
building Homebrew formulae, and may need to be deleted.

Unexpected .pc files:
  /usr/local/lib/pkgconfig/gepetto-viewer-corba.pc
  /usr/local/lib/pkgconfig/gepetto-viewer.pc
  /usr/local/lib/pkgconfig/openscenegraph-osgQt.pc```
</details>

<details><summary>Output of `brew cask doctor`</summary>

==> Homebrew-Cask Version
Homebrew-Cask 1.1.11-73-gb6d10769
caskroom/homebrew-cask (git revision a331; last commit 2017-03-14)
==> Homebrew-Cask Install Location

==> Homebrew-Cask Staging Location
/usr/local/Caskroom
==> Homebrew-Cask Cached Downloads
~/Library/Caches/Homebrew/Cask (1 files, 16.6MB)
==> Homebrew-Cask Taps:
/usr/local/Homebrew/Library/Taps/caskroom/homebrew-cask (3606 casks)
/usr/local/Homebrew/Library/Taps/caskroom/homebrew-fonts (1110 casks)
/usr/local/Homebrew/Library/Taps/caskroom/homebrew-versions (171 casks)
==> Contents of $LOAD_PATH
/usr/local/Homebrew/Library/Homebrew/cask/lib
/usr/local/Homebrew/Library/Homebrew
/Library/Ruby/Site/2.0.0
/Library/Ruby/Site/2.0.0/x86_64-darwin16
/Library/Ruby/Site/2.0.0/universal-darwin16
/Library/Ruby/Site
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/vendor_ruby/2.0.0
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/vendor_ruby/2.0.0/x86_64-darwin16
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/vendor_ruby/2.0.0/universal-darwin16
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/vendor_ruby
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/2.0.0
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/2.0.0/x86_64-darwin16
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/lib/ruby/2.0.0/universal-darwin16
==> Environment Variables
LANG="en_US.UTF-8"
PATH="/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/X11/bin:/Library/TeX/texbin:~/Repositories/AMD2/workspace/src/catkin/robots/hopperUser/x86_64mac:/usr/local/Homebrew/Library/Homebrew/shims/scm"
SHELL="/usr/local/bin/fish"```

I cannot test this as I can't even install it:
-bash-4.4.12- /Users/miccal [> brew cask install logitech-control-center
==> Downloading https://www.logitech.com/pub/techsupport/mouse/mac/lcc<IP_ADDRESS>.zip
######################################################################## 100.0%
==> Verifying checksum for Cask logitech-control-center
==> Running installer for logitech-control-center; your password may be necessary.
==> Package installers may write to any location; options such as --appdir are ignored.
Password:

I left it for an hour and nothing happened, so forced quit. Then:
-bash-4.4.12- /Users/miccal [> brew cask install logitech-control-center
Warning: A Cask for logitech-control-center is already installed.

To re-install logitech-control-center, run:
  brew cask reinstall logitech-control-center

Tried reinstalling:
-bash-4.4.12- /Users/miccal [> brew cask reinstall logitech-control-center
==> Downloading https://www.logitech.com/pub/techsupport/mouse/mac/lcc<IP_ADDRESS>.zip
Already downloaded: /Users/miccal/Library/Caches/Homebrew/Cask/logitech-control-center--<IP_ADDRESS>.zip
==> Verifying checksum for Cask logitech-control-center
==> Running uninstall process for logitech-control-center; your password may be necessary
==> Running uninstall script LCC Installer.app/Contents/Resources/LCC Uninstaller Tool
Password:

I left it for another hour and nothing happened, so forced quit. Then:
-bash-4.4.12- /Users/miccal [> brew cask zap logitech-control-center
==> Implied "brew cask uninstall logitech-control-center"
==> Running uninstall process for logitech-control-center; your password may be necessary
==> Running uninstall script LCC Installer.app/Contents/Resources/LCC Uninstaller Tool
==> 2017-03-15 07:53:59.284 LCC Uninstaller Tool[62516:2513600] Running LCC Uninstall tool. Arguments = (
==>     "/usr/local/Caskroom/logitech-control-center/<IP_ADDRESS>/LCC Installer.app/Contents/Resources/LCC Uninstaller Tool"
==> )
==> Removing files from pkgutil Bill-of-Materials
Warning: No zap stanza present for Cask 'logitech-control-center'
==> Removing all staged versions of Cask 'logitech-control-center'

Same issue.. tried multiple time & Multiple Macs .. same problem every where

Can't install it either - candidate for removal, I'd say.

Hi! I was about to add a new cask for logitech-control-center when I realised there was already one... but deleted.
Installation is working fine here (the cask I just created at least). Maybe something changed on Logitech's side?
❯❯ brew cask install logitech-control-center
❯ Installing logitech-control-center (logitech-control-center) into /Applications...
==> Caveats
You must reboot for the installation of logitech-control-center to take effect.

==> Downloading https://download01.logi.com/web/ftp/pub/techsupport/mouse/mac/lcc<IP_ADDRESS>.zip
######################################################################## 100.0%
==> Verifying checksum for Cask logitech-control-center
==> Running installer for logitech-control-center; your password may be necessary.
==> Package installers may write to any location; options such as --appdir are ignored.
Password:
==> installer: Package name is Logitech Control Center
==> installer: Upgrading at base path /
==> installer: The upgrade was successful.
==> installer: The install requires restarting now.
🍺  logitech-control-center was successfully installed!

❯ brew cask audit logitech-control-center --download
==> Downloading https://download01.logi.com/web/ftp/pub/techsupport/mouse/mac/lcc<IP_ADDRESS>.zip
Already downloaded: /Users/macxim/Library/Caches/Homebrew/Cask/logitech-control-center--<IP_ADDRESS>.zip
==> Verifying checksum for Cask logitech-control-center
audit for logitech-control-center: passed

@Macxim there is no logitech-control-center anymore.
Ref #30938

@Macxim feel free to open a PR it it is indeed working now.

@gobinathm I can see that. I was creating it when I saw the related issue and PR.
@miccal Will definitely do.

Hmm - I'm getting the "hanging after password" issue myself now (using the restored logitech-control-center package from @Macxim (using Sierra)


chore: fix version info

Ran into Cypress issues while getting too ambitious in #8157
this is a simplified more targeted version of it

include package.json (but not under static/)
use package.json as single source of truth for version info

@dpgaspar @craig-rueda

Addressed all comments, merging.


Unable to go get bosh-cli package

I need to work on a contribution to the Terraform provider for cloud foundry which lists this package as a dependency.  Upon trying to go get the package I run into the following error:
What's Wrong
bash-3.2$ go get -d github.com/cloudfoundry/bosh-cli
go: downloading github.com/cloudfoundry/bosh-cli v0.0.159
go: downloading github.com/cloudfoundry/bosh-cli v6.4.1+incompatible
go get<EMAIL_ADDRESS>stream error: stream ID 9; NO_ERROR

What's Expected
I expect the package to be installed similar to this example from Google
bash-3.2$ go get github.com/google/codesearch/index
go get: added github.com/google/codesearch v1.2.0

Versions of Tools listed as Dependencies according to the README
bash-3.2$ go version; hg version; git version
go version go1.16.4 darwin/amd64

Mercurial Distributed SCM (version 5.9)
(see https://mercurial-scm.org for more information)

Copyright (C) 2005-2021 Olivia Mackall and others
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

git version 2.31.1

If you want to use the bosh cli, please follow the installation instructions as documented here: https://bosh.io/docs/cli-v2-install/.
This is also mentioned in the README: https://github.com/cloudfoundry/bosh-cli#install
Instruction on how to use it as a library are documented here: https://github.com/cloudfoundry/bosh-cli#client-library


Handle multi-arch builds in Xcode lipo phase

Correctly split ARCHS into a Bash array in xcode_backend.sh.
Previously, when ARCHS contained multiple values (e.g., ARCHS="armv7 arm64"),
we treated that as a single architecture, and lipo invocation would
fail.

LG


refactor(BackgroundImage): refactor CSS vars

fixes https://github.com/patternfly/patternfly-next/issues/982

Deploy preview for pf-next ready!
Built with commit 87178a7123fb603a403ca571966f456a107078a3
https://deploy-preview-1106--pf-next.netlify.com

Looks good.


Android Notepad App

Requirements for the app:-

User can create a note
User can edit a note
User can delete a note
When closing the browser window the notes will be stored and when the User returns, the data will be retrieved.

Requirements for the README:-

All the concepts learned
Try to use Room Database
Official Documentation usage
further improvements in the app.

Kindly attach all the Assets in the folder itself than to host somewhere else.

I will make this project.

@dubesar  Can I talk to you personally through any other medium.

@kunal299 you can contact me through<EMAIL_ADDRESS>

This issue is open and will be accepted on a first come first serve basis, Thanks for contributing!!

Sir, can I work.on this project for hacktoberfest2020?

@animsh As I said this will be first come first server project.

Should the UI of the app be minimal?

Hi. I'd like to work on this.
Is the entire app to be submitted in one go, or can we work on parts of it?

@adizcode I am doing this project.

@kunal299 Okay. If you choose not to do it, please tag me here.

@kunal299 are you up for this project?

A little bit is left, I will create the pull request tonight.

@dubesar Hey, Can I create pr tomorrow? I am not able to complete the project today.

@kunal299 sure but do it as soon as possible.

oh! sorry, @kunal299 I didn't see that you're working on this issue. I started working on it since it first opened and I didn't comment that I'll work on it :\

@xloli20 This is wrong, it's a must to write a comment and then start the project. The project is given on a first come first serve basis. I have also completed the project.

@kunal299 you can also make a pull request, no worries we can have two similar projects but ensure that they come under same folder.

@kunal299 can you add more android projects in the issues tab and make some of them also If possible let it be assigned to someone, Actually I have a little less time under my belt so that you can maintain the repo for now. Please contact me over email so that I can guide you regarding this

@kunal299 you can also make a pull request, no worries we can have two similar projects but ensure that they come under same folder.

It's fine with one project, I saw his project but I found one issue that when we make the note and write the description in the note and then we save it. When we open the note that we wrote, the description is saved as same as the title.

@kunal299 can you add more android projects in the issues tab and make some of them also If possible let it be assigned to someone, Actually I have a little less time under my belt so that you can maintain the repo for now. Please contact me over email so that I can guide you regarding this

Sure, I will maintain the repo and add as many Android Projects as I can.

@xloli20  Please fix the issue that I mentioned above in the comments and make a pull request again. By the way, You have made the readme file awesome.

@kunal299 you can also make a pull request, no worries we can have two similar projects but ensure that they come under same folder.

How can I add it under the same folder as I have created the fork of your repo earlier?

Pull all the changes in the repo and the commit
On Fri, 2 Oct 2020, 10:26 Kunal Mali<EMAIL_ADDRESS>wrote:

@kunal299 https://github.com/kunal299 you can also make a pull request,
no worries we can have two similar projects but ensure that they come under
same folder.
How can I add it under the same folder as I have created the fork of your
repo earlier?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/dubesar/Java-A-Z/issues/247#issuecomment-702524772,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AJHVD5T35HJLFTNMC6IQQBLSIVMPFANCNFSM4R2454QQ
.

Do I have to create the file named "Android Notepad App 1" in the android projects?

@xloli20  Are you working on the issue of the note not being saved properly when we go to edit the file. The title is copied to the description when we open the note again.

@kunal299 oh! thanks for pointing that out. it was a simple mistake, I will PR now!


Design Timeseries Average (Mean) Calculator

What's needed?
For forecasting we have been using average load and production profiles.
Given a time series, we want a module that is able to calculate the item wise average of repeating time windows of the same size and the same sample-rate, possibly all having the same distance.
Example:
Consider the time series $T = [1,2,3,4,5,6,7,8,9,1]$ and a window a length $2$ with distance $2$ starting at the first position.
Hence we get the sub-series $t_1=[1,2], t_2=[5,6], t_3=[9,1]$ and therefore the average $$t_{avg}=[(1+5+9)/3, (2+6+1)/3] = [5, 3]$$
Note: A position could likewise be a timestamp in a usual time-series representation.
Proposed solution
We want to design such a module in a way such that it

uses batches of data (most likely cached in memory)
is designed to work together with the data structure defined here
it should be able to run calculations on demand and memoize the result

Use cases
It's been used for calculating average load and production profiles certain days.
For example it could just calculate the average load of some consume of the last seven days as well as the average PV production of the last four Tuesdays.
Alternatives and workarounds
It's possible to run the calculation and update the mean on a data stream whenever a new sample arrives. However we plan on storing batches of data in any case, as this can be used as a feature for ml models, and thus calculating the averages from the batches seems obvious.
Additionally this option hasn't been further explored so far.
Additional context
We have had a use-case where we where looking at a full days averaged data plus a 15 minute margin. Thus we will need to add a margin for a window size in order to re-engineer this feature.

We'll probably be able to use https://numpy.org/doc/stable/reference/generated/numpy.lib.stride_tricks.as_strided.html#numpy.lib.stride_tricks.as_strided for accessing arrays in strides in numpy
possilby helpful: https://numpy.org/doc/stable/reference/generated/numpy.mean.html

We need a margin around the window, such that we can say we want a specific load profile of a certain weekday +-15min. That would translate to the following parameters:
window_size = 1day
distance = 6days
margin = 15min

We could also consider introducing independent left and right margins.

possilby helpful: numpy.org/doc/stable/reference/generated/numpy.mean.html

Indeed useful. We can reshape the array into an 2 dimensional first and use the where array to select which values to include, i.e. leaf out all values that are not in any window or window margin. Using numpy's internal functions is likely faster then iterating over the values in python for calculating the mean.

Note: Average Time Series can be empty or a series of zeros.

Should be able to calculate mean, standard deviation and polynomial coefficients.

It is important to note that the TimeseriesAverageCalculator takes the samples from the SlidingWindowOperator / StreamBucketOperator and computes the averages from that. The structure of the resulting static array should be defined in the constructor to make sure this can't be changed at runtime.
We should also give an example on how this the TimeseriesAverageCalculator calculation can be invoked in a memoized fashion e.g. if the calculation hasn't been updated since a certain amount of time or if a new day has arrived. Please be aware of time zones.

For your information, aggregate functions over windows of varying size may be useful. For example, for frequency forecast, some of the most important features include mean over the last 30 seconds of data, and other means over 15 minutes of data.

For example, for frequency forecast, some of the most important features include mean over the last 30 seconds of data, and other means over 15 minutes of data.

sure. thats no problem and does not speak against using a fixed buffer size. if someone is only interested into parts of the data in the buffer thats fine. we have accounted for that use case as for example this is required for the peak shaving.

Say in this example that was mentioned before:
window_size = 1day
distance = 6days
margin = 15min

I am assuming this takes the window of 1 day starting from the point in time when the TimeseriesAverageCalculator is ran, right? So if I want the average of a specific weekday then I should run this just after the end of that day? Is that the idea?

Also just to clarify. If we want the data at a specific sampling rate this is taken care of here, right?

Say in this example that was mentioned above:
window_size = 1day
distance = 6days
margin = 15min
I am assuming this takes the window of 1 day starting from the point in time when the TimeseriesAverageCalculator is ran, right? So if I want the average of a specific weekday then I should run this just after the end of that day? Is that the idea?

That depends. The MovingWindow can be aligned to start at a certain point in time. This module will have an offset. So if e.g. you store 29days of data that is aligned to start on Monday then you can set the offset to 2 days and get the profile for Wednesdays.

Some notes from today's meeting (and from #299):

Maybe something like LagWindow would be a better name (see https://en.wikipedia.org/wiki/Lag_operator)?
In future we would also need other metrics like e.g. min, max, std.
Some use-cases could include:

Maximum value for the upcoming 15min time period for the same weekday in the last 28 days.
Average value for the 1h time period 2h in the future for the last 5 days.
Standard deviation for the 1h time period 23h in the future over the last 28 days.

@idlir-shkurti-frequenz  and @cwasicki will propose some unit tests for our use cases.
Can it be used directly with numpy arrays instead of moving window?
Does it make sense to also provide a step-wise definition of the window in addition to use datetimes?
Instead of creating multiple objects with different distances, it could be advantageous to work with weights of zero to select a sub-range.
What's the (desired) behaviour if the window is incomplete?

@matthias-wende-frequenz @idlir-shkurti-frequenz Anything to add?

In future we would also need other metrics like e.g. min, max, std.

@matthias-wende-frequenz this should be pretty straight forward to implement right? can you create a seperate issue for that once the PR is merged?

Can it be used directly with numpy arrays instead of moving window?

@cwasicki what would be the use case?

Does it make sense to also provide a step-wise definition of the window in addition to use datetimes?

@cwasicki If there are not dates what is the point of reference? Everything is based on timestamps.... how would that work?

What's the (desired) behaviour if the window is incomplete?

@cwasicki what is an incomplete window? like when the app starts and there is not enough data yet to create the averages? what has this to do with the MovingWindow? Sounds like like an upstream problem imho

@cwasicki what would be the use case?

We could use it for feature generation on data frames for example and use it now already.

@cwasicki If there are not dates what is the point of reference? Everything is based on timestamps.... how would that work?

If you work equidistantly sampled data you could easily reference N time steps ahead.

@cwasicki what is an incomplete window? like when the app starts and there is not enough data yet to create the averages? what has this to do with the MovingWindow? Sounds like like an upstream problem imho

Yes, if you don't have enough data. For instance, what is the expected behaviour in case we want a last 4 same weekdays average on a completely new site? First week you have no data, next three weeks you still have less than the 4 days you asked for. Options could be to just use any data that is available (and maybe warn), return None or throw an exception. I would prefer the first option. But it also depends on the implementation since the weights may not match anymore.

We could use it for feature generation on data frames for example and use it now already.

Right so, if you replace the MovingWindow with a numpy array you essentially just pumping all data thats incoming into memory. So is the use case about model training?

Yes, if you don't have enough data. For instance, what is the expected behaviour in case we want a last 4 same weekdays average on a completely new site

Thats not a question about the MovingWindow but rather application level of what the fallback behaviour would/should look like. Can you put that on the DS agenda?

Right so, if you replace the MovingWindow with a numpy array you essentially just pumping all data thats coming out of the Resampler into memory. So is the use case about model training? Can you please give some more precise examples/explanation, please :-)

Yes, it's about model training. We are using data frames for this, so essentially numpy arrays. If it's possible we could apply only the TimeSeriesAverager from the SDK already now for creating features on our training data. Example could look like:
def tsavg(pd_series):
    # Code using TimeSeriesAverager with a pandas Series or numpy array
    ...
    return avg

# Calling tsavg over a 7 day rolling window in a pandas data frame
df.roll("7D")["some_column"].apply(tsavg)

Thats not a question about the MovingWindow but rather application level of what the fallback behaviour would/should look like. Can you put that on the DS agenda?

Sure, the application should always be responsible how this is handled. There should still be a clearly defined behaviour of the TimeSeriesAverager in this case. Added it to the agenda.

In future we would also need other metrics like e.g. min, max, std.

@matthias-wende-frequenz this should be pretty straight forward to implement right? can you >> create a seperate issue for that once the PR is merged?

@cwasicki can you please define what you mean by min, max, std in this context?

@cwasicki can you please define what you mean by min, max, std in this context?

For the TimeSeriesAverager you select a subset of the moving window and then take the average of these values. Similarly, you could also get the maximum, minimum or standard deviation on this subset. For instance, what was the maximum value in a specific time period of the day over the last 7 days.

can you please define what you mean by min, max, std in this context

@cwasicki is that the min, max and std of the averaged timeseries or the underlying MovingWindow? @matthias-wende-frequenz that indeed raises a good question if renaming the TimeseriesAverager to MovingWindowAverager is really to way to go. At the very end the derived timeseries isn't really anymore connected the the MovingWindow itself that contains raw data whereas the TimeseriesAvergager contains derived statistical measures from the MovingWindow.

@cwasicki is that the min, max and std of the averaged timeseries or the underlying MovingWindow?

I meant the underlying moving window. To clarify with an example: Assuming it's 15:00. Based on a time series window with data points every 15 min for the last 28 days, if you want to have the minimum for a time period of today 10:00 - 10:30 (i.e. two data points) and a distance of 7 days (i.e. 4 times a window with 2 data points) you would receive two values. The first value is the minimum value of the four values of 10:00-10:15 data points today, 7, 14 and 21 days ago. Equivalently you determine the second value, but for the 10:15-10:30 data points instead.

A potential use-case could be for a PV forecast: the production of a recent sunny day gives you at least some indication of the potential of your PV system for the given time period. You can get some estimate by taking the maximum of that time period over the last couple of days. In contrast to that, the production on cloudy days don't tell you much about the future unless you combine it with very good weather forecast data.


Need more clarity on HA of 99.99

This page doesn't clarify how many instances is required for 4 9s. There are many other pages which creates ambiguity in the understanding of High Availability offered.
I am still confused with the HA of four 9s. When I purchase a single instance of the standard tier is four 9s available to me ?
OR I have to buy at least some instances to get these 4 9s ?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c58c2dff-dcca-2a91-8f0b-9dc0853c5fb5
Version Independent ID: f59e13bd-bcd1-c7e6-dd45-4a7834a6c8db
Content: General Purpose service tier - Azure SQL Database & Azure SQL Managed Instance
Content Source: articles/azure-sql/database/service-tier-general-purpose.md
Service: sql-db-mi
Sub-service: features
GitHub Login: @jovanpop-msft
Microsoft Alias: jovanpop

@arpit9mittal Thank you for the feedback. We are actively investigating and will get back to you soon.

@arpit9mittal We don't have to buy multiple instances of specific resource or services to have high availability of 99.99. If we look at below screenshot, it provides the similar details about different tiers and their availability.

You can refer to below links for more details:
https://azure.microsoft.com/en-in/blog/new-azure-sql-database-service-tiers-generally-available-in-september-with-reduced-pricing-and-enhanced-sla/
https://azure.microsoft.com/en-us/support/legal/sla/sql-database/v1_5/
Please let me know if this helps or else we can discuss further on the same.

Thanks, but I still have ambiguity please help clarify it .
As per the link -
https://azure.microsoft.com/en-us/support/legal/sla/sql-database/v1_5/
Azure SQL Database Business Critical or Premium tiers not configured for
Zone Redundant Deployments, General Purpose, Standard, or Basic tiers, or
Hyperscale tier with two or more replicas have an availability guarantee of
at least 99.99%.
Question: Do I have to purchase replicas ? If not then how many replicas
are available? Are the replicas based on tier ?
Regards
Arpit Mittal
On Mon, Dec 28, 2020 at 11:34 PM AnuragSharma-MSFT<EMAIL_ADDRESS>wrote:

@arpit9mittal https://github.com/arpit9mittal We don't have to buy
multiple instances of specific resource or services to have high
availability of 99.99. If we look at below screenshot, it provides the
similar details about different tiers and their availability.
[image: image]
https://user-images.githubusercontent.com/66360845/103258877-06ffb500-49bd-11eb-8a66-b6943a12a4ad.png
You can refer to below links for more details:
https://azure.microsoft.com/en-in/blog/new-azure-sql-database-service-tiers-generally-available-in-september-with-reduced-pricing-and-enhanced-sla/
https://azure.microsoft.com/en-us/support/legal/sla/sql-database/v1_5/
Please let me know if this helps or else we can discuss further on the
same.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/azure-docs/issues/68140#issuecomment-751942779,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADTOFWVCJCABY4OXDK4KHJTSXFL37ANCNFSM4VLSJVLA
.

@arpit9mittal As per the article, "High availability is implemented using a technology similar to SQL Server Always On availability groups. The cluster includes a single primary replica that is accessible for read-write customer workloads, and up to three secondary replicas (compute and storage) containing copies of data".
So yes we need to configure replicas and they will charge based on their compute and storage size. Please refer to below article on creating it:
https://docs.microsoft.com/en-us/azure/azure-sql/database/active-geo-replication-configure-portal
Please let me know if this helps.

Hi Anurag,
Now this is going in a circle. I didn't ask for a geo-replication, but the
question was different.
Please note, i have two email threads, one is for standard tier and other
is for premium tier.
Can we talk over the phone? or zoom etc ?
Regards
-Arpit Mittal
On Tue, Dec 29, 2020 at 11:19 PM AnuragSharma-MSFT<EMAIL_ADDRESS>wrote:

@arpit9mittal https://github.com/arpit9mittal As per the article
https://docs.microsoft.com/en-us/azure/azure-sql/database/high-availability-sla#premium-and-business-critical-service-tier-locally-redundant-availability,
"High availability is implemented using a technology similar to SQL
Server Always On availability groups. The cluster includes a single primary
replica that is accessible for read-write customer workloads, and up to
three secondary replicas (compute and storage) containing copies of data
".
So yes we need to configure replicas and they will charge based on their
compute and storage size. Please refer to below article on creating it:
https://docs.microsoft.com/en-us/azure/azure-sql/database/active-geo-replication-configure-portal
Please let me know if this helps.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/azure-docs/issues/68140#issuecomment-752322198,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADTOFWXKMVM24F7JYTN7BMDSXKS5FANCNFSM4VLSJVLA
.

@arpit9mittal I think I understand the confusion. If you want to purchase replica (not through geo-replication) you just need to set the Zone Redundancy, Azure fabric takes care of creating the replicas behind the scenes and it is charged similar way. For General Purpose tier, zone redundancy incurs an additional cost. As an example if I create a General Purpose database with no Zone redundancy I pay around USD $380 per month. While If I go for it, cost goes around USD $520. This is very specific to Zone Redundancy.
On question of number of replicas, there is no primary information available based on tiers but I am reaching out to internal product group to have more clarity.
Also General Purpose, Standard, or Basic tiers offer at least 99.99% of availability as per the article. As zone redundancy is still in preview for GP, its not clearly mentioned if this increases the availability beyond 99.99 and I will put the same to PG as well.
Now coming back to original question, yes if you configure the single instance of standard tier you will get the availability of 99.99. You can refer to above article for the same.

Hi Anurag,
Are you talking about zone redundancy with standard tier?
If Yes, I was not aware of this feature available. Please provide the
architecture diagram and RPO, RTO, HA with it.
Regards
-Arpit Mittal
On Wed, Dec 30, 2020 at 4:14 AM AnuragSharma-MSFT<EMAIL_ADDRESS>wrote:

@arpit9mittal https://github.com/arpit9mittal I think I understand the
confusion. If you want to purchase replica (not through geo-replication)
you just need to set the Zone Redundancy, Azure fabric takes care of
creating the replicas behind the scenes and it is charged similar way. For
General Purpose tier, zone redundancy incurs an additional cost. As an
example if I create a General Purpose database with no Zone redundancy I
pay around USD $380 per month. While If I go for it, cost goes around USD
$520. This is very specific to Zone Redundancy.
On question of number of replicas, there is no primary information
available based on tiers but I am reaching out to internal product group to
have more clarity.
Also General Purpose, Standard, or Basic tiers offer at least 99.99% of
availability as per the article
https://docs.microsoft.com/en-us/azure/azure-sql/database/service-tiers-general-purpose-business-critical#service-tier-comparison.
As zone redundancy is still in preview for GP, its not clearly mentioned if
this increases the availability beyond 99.99 and I will put the same to PG
as well.
Now coming back to original question, yes if you configure the single
instance of standard tier you will get the availability of 99.99. You can
refer to above article for the same.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/azure-docs/issues/68140#issuecomment-752385381,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADTOFWWQF6MILN2CSGJCQVDSXLVQJANCNFSM4VLSJVLA
.

@arpit9mittal Thanks for reverting back. I was not talking about zone redundancy in standard tier. It is currently not available. I was just giving an example that if we go for GP in vCores it incurs extra cost for zone redundancy.
With respect to standard tier, as I already mentioned in my last comment that we get an availability of 99.99 with even single instance that we create.
For RTO and RPO for zone redundancy, as mentioned in #68142 I am reaching out to Product team as we don't have any specific information available.
Please let me know if this helps and we can close this issue and follow up on the other issue where we have the discussion going on. Otherwise if you still have queries we can gladly continue the discussion here itself.

Thanks Anurag for the clarification. Yes we can close this and follow-up on
the other thread w.r.t to premium tiers.
Regards
Arpit Mittal

Sent from Android

On Wed, 30 Dec, 2020, 12:04 pm AnuragSharma-MSFT<EMAIL_ADDRESS>wrote:

@arpit9mittal https://github.com/arpit9mittal Thanks for reverting
back. I was not talking about zone redundancy in standard tier. It is
currently not available. I was just giving an example that if we go for GP
in vCores it incurs extra cost for zone redundancy.
With respect to standard tier, as I already mentioned in my last comment
that we get an availability of 99.99 with even single instance that we
create.
For RTO and RPO for zone redundancy, as mentioned in #68142
https://github.com/MicrosoftDocs/azure-docs/issues/68142 I am reaching
out to Product team as we don't have any specific information available.
Please let me know if this helps and we can close this issue and follow up
on the other issue where we have the discussion going on. Otherwise if you
still have queries we can gladly continue the discussion here itself.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/azure-docs/issues/68140#issuecomment-752691820,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADTOFWX5ZQJQQYYKIMVTM33SXNMS5ANCNFSM4VLSJVLA
.

Thanks @arpit9mittal. Thanks for confirming. We will close this thread now and follow up on the other one.


Fix broken link in Build Cache chapter.

r? @alexcrichton
(rust_highfive has picked a reviewer for you, use r? to override)

@bors: r+

:pushpin: Commit 66d2607a97f5457e754cc49c984c26e49b097938 has been approved by alexcrichton

:hourglass: Testing commit 66d2607a97f5457e754cc49c984c26e49b097938 with merge a5c3b50ce57bb4a760ff64571d3327e49b9d8fda...

:sunny: Test successful - checks-actions
Approved by: alexcrichton
Pushing a5c3b50ce57bb4a760ff64571d3327e49b9d8fda to master...


CloudQuery-based indexer that supports Azure

This is the second pass at my previous CloudQuery PR. This has pretty much feature parity with what you can do with the  Kubernetes indexer. It sets up similar template variables and you can do the same things in match predicates. Azure uses the term "tag" instead of the Kubernetes "labels" and "annotations", so for tag-based match predicates you use the terms "tags", "tag-keys", and "tag-values" to match against the tags.
I've tested this in my local dev environment, but I didn't get a chance to test this version in the Docker image deployment scenario, so I still need to test that. I thought I'd still issue the PR now to pipeline things a bit with Shea doing the code review. If there was a regression in the Docker deployment, I think it will only require a minor tweak.
I still need to write up some more complete documentation about how to configure everything and how these changes affect gen rule authors: Here's what my test CloudQuery/Azure gen rules file looked like, just to get a taste:
apiVersion: runwhen.com/v1
kind: GenerationRules
spec:
  platform: azure
  generationRules:
    - resourceTypes:
        - virtual_machine
      matchRules:
        - type: pattern
          pattern: ".+"
          properties: [name]
          mode: substring
      slxs:
        - baseName: vm-health
          levelOfDetail: basic
          qualifiers: [resource_group]
          baseTemplateName: az-vm-health
          outputItems:
            - type: slx
            - type: runbook
              templateName: az-vm-health-taskset.yaml
    - resourceTypes:
        - virtual_machine
      matchRules:
        - type: pattern
          pattern: "Another"
          properties: [tags]
          mode: substring
      slxs:
        - baseName: vm-health2
          levelOfDetail: basic
          qualifiers: [resource_group]
          baseTemplateName: az-vm-health
          outputItems:
            - type: slx
            - type: runbook
              templateName: az-vm-health-taskset.yaml
    - resourceTypes:
        - virtual_machine
      matchRules:
        - type: pattern
          pattern: "Linux"
          properties: [computerName]
          mode: substring
      slxs:
        - baseName: vm-health3
          levelOfDetail: basic
          qualifiers: [resource_group]
          baseTemplateName: az-vm-health
          outputItems:
            - type: slx
            - type: runbook
              templateName: az-vm-health-taskset.yaml

Below are the more detailed comments from the commit messages:
   CloudQuery-based indexer implementation

    - currently only has configuration/spec for the Azure platform (and only
      a small number of tables/resource-types), but it's easy to add more.
    - made some changes to the PlatformHandler interface to construct
      qualified resource name by delegating to the handler.
    - implemented code in the Azure platform handler to obtain the resource
      group for the resource and use that to construct the qualified name.
    - updated the Dockerfile to install the cloudquery CLI. Note that this
      only pre-installs the CLI itself. The platform plugins that are used
      are downloaded/installed dynamically. I think that should be ok, but
      we'll have to see.
    - I did the development of this before they released a new major version
      (4.0) a couple of weeks ago, so currently we're pinned to the specific
      older versions of the CLI and Azure plugin, since that's what I
      developed against. I need to look more into what the changes were for the
      new version and what changes I need to make to work with that. Although
      since it's a brand new major version we probably want to wait a while
      in case there are any problems with the new code.

    - fixed bugs with resource group support
    - finished implementation of the Azure platform handler
    - deserialize the Azure resource tags and instance_view so that the data
      is accessible from templates and match rules
    - support for tag-based match rules modeled on the Kubernetes labels and
      annotations. It works exactly the same way except that the property
      names are "tags", "tag-keys", and "tag-values"
    - path-based matches work in a similar way too. The resource data is
      initialized from the "instance_view" field from the Azure CloudQuery
      table. This was set for the virtual machine table, but I need to check
      other table types to see if this is the standard name that is used or
      if other tables should use a different name.
    - added code to be smarter about which tables are configured in the
      per-platform CloudQuery config files, i.e. only include the tables
      that are actually referenced by gen rules, plus mandatory tables that
      are always indexed since they may be referenced by other resource
      types, e.g. resource groups for Azure
    - fixed some bugs in the handling of the standard/built-in template
      variable names. Also, made sure they were set for the template
      variables that are passed to the customization rules.
    - fixed a few other places in the gen rules code that were doing
      Kubernetes-specific things, e.g. looking up a namespace
    - lookup setting values by setting variable as well as just the name

@vaterlaus the initial docker build functions properly and existing k8s functionality looks fully functional. Do you have some guidance on how to configure the credentials and workspaceInfo.yaml details for this provider? I'd like to set up a couple of resources and test some genrules, potentially for an existing load balancer taskset that we have.


Env variables for custom airflow docker images

Just giving this a spin with my own images and one of the reasons it doesn't currently work for me is that certain env variables (AIRFLOW__CORE__SQL_ALCHEMY_CONN and AIRFLOW__CORE__FERNET_KEY in particular) are composed in the entrypoint.sh as opposed to directly from env vars. It appears the airflow docker image is based on https://github.com/puckel/docker-airflow, is that correct? Are there reasons why the airflow Dockerfile wouldn't be part of this repo? (I'm using a different docker image which doesn't have the same entrypoint as that one.)
In any event, my suggestion would be to try and keep the go build process decoupled from any particular docker image/entrypoint. I see the args are configurable in utils.go. For sensitive config parameters (e.g. sql_alchemy_conn and fernet_key), these would probably have to come from kubernetes secrets and be injected as env_vars in the UI, scheduler, and k8s worker.

Thanks for reaching out. Thats correct. I should have made it explicit in the readme or userguide (pending).
Please refer to my airflow-docker repo which is forked from puckel.
I have a pending task to upstream my changes.
https://github.com/barney-s/docker-airflow
changes:
https://github.com/puckel/docker-airflow/compare/master...barney-s:master
Let me know if i can help any other way.

thanks I'll have a look.


1.0.23 freeze at logo on opening.

Since the last update (1.0.23) I have been unable to access the Agoradesk application.

Android 13.

On opening the screen freezes at the white background with blue logo screen.

Can you please clarify what version did you use:

apk from github
foss
install from Play market

Can you please try to remove the app and install again.
I can't repeat the bug.

Can you please try to remove the app and install again.
I can't repeat the bug.

Found a bug, fixing.

It looks like fixing could take a while, as the reason in a third-party plugin.
Please use the previous release https://github.com/AgoraDesk-LocalMonero/agoradesk-app-foss/releases/tag/v1.0.21
This issue is our priority, hope to fix it soon.

Can you check the last release, please
https://github.com/AgoraDesk-LocalMonero/agoradesk-app-foss/releases/tag/v1.0.26


Scale out with marmot

This is a great example .
would like to add the needed docker to allow it to scale out on fly.io.
it setups up the db in multi master fashion with only a docker file .
https://github.com/maxpert/marmot-pocketbase-flyio Has the docker file which we can adapt

Thanks for the idea, but i don't think it's really in the scope of this project. It's just supposed to be a small example without deployment, scaling etc.


Download error file with cyrillic symbols

Then i try download file with cyrillic symbols in the name, i getting this error
Error: /folder/ÃÂÃÂµÃÂ·ÃÂÃÂ¼ÃÂÃÂ½ÃÂ½ÃÂÃÂ¹ ÃÂ´ÃÂ¾ÃÂºÃÂÃÂ¼ÃÂµÃÂ½ÃÂ~
But if file already there with same name and i trying download it, it's ok, download successful and cyrillic symbols in log looks normal.
Linux
Atom 1.0.0
remote-sync 3.1.2

should fixed by #186


the maximum size of connection pool is 100 connections but the pending queue keeps growing

Describe the bug
This issue happens sometimes on our production environment. When the problem occurs, our service starts timing out when attempting to open a SQL connection to a SQL Azure Database. Other instances of the service are able to open connections to the same SQL DB without problems. The same instance of the service is able to establish connections to other SQL Azure Databases. The only solution that we found for mitigating the problem is to restart the instance of the service that is failing to open the connection.
Given that the problematic service instance is able to establish connections to other other databases, one of our theories was that perhaps we are exhausting SQL connection pool. So we have added monitoring around the state of the SQL connection pool. We fell back to using reflection to get to the internal state of DbConnectionPool objects.
Here is our logging code and parameters that we are logging =>
var assembly = typeof(SqlConnection).Assembly;
var factory = assembly.GetTypes().Where(t => t.Name == "SqlConnectionFactory").FirstOrDefault();
var property = factory.GetField("SingletonInstance", BindingFlags.Static | BindingFlags.Public);
var sqlConnectionFactoryInstance = property.GetValue(null);

var connectionPoolGroups = GetPrivateFieldValue<IDictionary>(sqlConnectionFactoryInstance, "_connectionPoolGroups", baseType: true);

foreach (var connectionPoolGroupKey in connectionPoolGroups.Keys)
{
    var connectionPoolGroup = connectionPoolGroups[connectionPoolGroupKey];
    var poolCollection = GetPrivateFieldValue<IDictionary>(connectionPoolGroup, "_poolCollection").Values;

    foreach (var pool in poolCollection)
    {
        var poolGroupIdHash = connectionPoolGroupKey?.GetHashCode();
        var poolIdHash = GetPrivateFieldValue<object>(pool, "_identity")?.GetHashCode();
        var totalConnectionsCount = GetPrivateFieldValue<int>(pool, "_totalObjects");
        var minPoolSize = GetPrivatePropertyValue<int>(pool, "MinPoolSize");
        var maxPoolSize = GetPrivatePropertyValue<int>(pool, "MaxPoolSize");
        var availableConnectionsNewCount = GetPrivateFieldValue<ICollection>(pool, "_stackNew")?.Count;
        var availableConnectionsOldCount = GetPrivateFieldValue<ICollection>(pool, "_stackOld")?.Count;
        var pendingOpensCount = GetPrivateFieldValue<ICollection>(pool, "_pendingOpens")?.Count;
        var waitCount = GetPrivateFieldValue<int>(pool, "_waitCount"); // Number of threads trying to open connection. Seems similar to the previous metric

        Logger.LogInformation(
            "SQL pool stats. " +
            "poolGroupIdHash: {poolGroupIdHash}" +
            "poolIdHash: {poolIdHash}" +
            "totalConnectionsCount: {totalConnectionsCount}" +
            "minPoolSize: {minPoolSize}" +
            "maxPoolSize: {maxPoolSize}" +
            "availableConnectionsNewCount: {availableConnectionsNewCount}" +
            "availableConnectionsOldCount: {availableConnectionsOldCount}" +
            "pendingOpensCount: {pendingOpensCount}" +
            "waitCount: {waitCount}",
            poolGroupIdHash.AsSystemMetadata(),
            poolIdHash.AsSystemMetadata(),
            totalConnectionsCount.AsSystemMetadata(),
            minPoolSize.AsSystemMetadata(),
            maxPoolSize.AsSystemMetadata(),
            availableConnectionsNewCount.AsSystemMetadata(),
            availableConnectionsOldCount.AsSystemMetadata(),
            pendingOpensCount.AsSystemMetadata(),
            waitCount.AsSystemMetadata());
    }
}

Basically we are logging the following fields and properties from the DbConnectionPool object: _totalObjects, MinPoolSize, MaxPoolSize, _stackNew.Count, _stackOld.Count, _pendingOpens, _waitCount
Below are the log details when we start to see the problem occurring. We are seeing that _pendingOpens keeps growing and growing and growing. And the growth started after _waitCount got flipped from 0 to 1.

We suspect that there is a concurrency bug of some sort in SQL client that leads to the behavior described above. One of connection is just blocking all new ones and keeping under wait status. There is no other solution than restarting our service and by restart all transactions are wiped out from the pool.
Expected behavior
We expect the client will use the all possible available connections from the pool and not blocking new connection requests.
Further technical details
Microsoft.Data.SqlClient version: 1.1.1
.NET target: .NET Core 2.1
SQL Server version: Microsoft SQL Azure (RTM) - 12.0.2000.8
Operating system: Ubuntu - 16.04.6 LTS (Xenial Xerus)

That is a very old version of SqlClient you use - have you tried 2.1.0 ?

Our version has latest update on last June, I don't think it is really old. On the other hand, we tried couple of times to upgrade the version of SqlClient (not 2.1.0 - it is released 4 days ago I see), we revert it back due to some other bugs. We can give another try to upgrade our client.
But do you know there are changes on the creation of connection between these versions? Or any related bug/fix is pointing on this kind of issue?

@bahadirbal
What issue have you been facing with v2.1.0?
Please provide details so we can help you get past those.
You can view all release notes here: Release Notes and most importantly v2.0.0 Breaking changes.

@cheenamalhotra
We have not tried to upgrade to v.2.1.0 yet. I will try to upgrade the version. The issues were on previous versions.
Regarding to your share about MARS, #422, we explicitly enabled MARS as workaround of this issue #54. We faced this on production and that is why disabling MARS is not ideal for now, since I am also seeing recent activities/comments on the issue "The connection is closed". Do you confirm this #54 is resolved in v2.1.0?
Regarding to repro steps, we are not hitting this issue all the time. That is why we added logging these connection pools statistics and try to catch something from these numbers. Do you have any other suggestion that we can enhance our investigation? listen some events etc?

Yes #54 is now fixed with v2.1.0.
The issue #422 affects all MARS cases on Unix platforms when connecting in parallel in high volume, so would recommend keeping it "false" now unless you can manage to ensure requests don't go in parallel to the driver.

@bahadirbal is the issue resolved?

Closing the issue due to inactivity. Feel free to comment here or open a new issue.