Видео

Great Channel Anna 🎉 👌

Databricks completed? I mean are those enough for batch processing projects?

Thanks

when you say, don't use !=, can you also suggest what method to use otherwise?

what happens if connection is not successful after download of the integration runtime

are these tables delta tables?

Is there any way to have the csv output file name match the source json file name?

In the query to delete the duplicates the query will also print the record which is duplicate as one of the record is ranked as 1

Example for frequent, unfrequent,

i got 3 errors 154 commented memebers not got any single error woow great please help

aggregate table creation error: IllegalArgumentException: All week-based patterns are unsupported since Spark 3.0, detected: e, Please use the SQL function EXTRACT instead

Thank you! Excited for the course.

Covered all the cases, excellent work!!

good explanation thanks but all this are not working in a pipeline can u make a new video for all pramaterization videos (19 ,20,21 videos) by creating new pipeline and triggering it

i have create same as above dataset by going to adf ---author---dataset---its working!! fine 2- when i try to create same dataset via using new pipeline and copy activity---source (dataset) same as above in video and sink as blob 3-when i try to run pipeline im getting error no value provided to parameter db name and table name in case my question is not clear excuse me ! 4- how to do the same activity using pipeline and triger it?

Very informative bro tnq

can me rename a column drop a column n re arrange the column with derived cloumn as we did in select? if yes then what is the difference between select n derived

The file '_SUCCESS' may not render correctly as it contains an unrecognized extension triger got sucessful but in container i have recieved file as scuess with 0kb when i open it i get above message without any file to preview or edit

how to delete table from sql via delete activity ?

this video is helpful for training people who are learning to transition to cloud computing.keep posting

What does KPI means?

hi can you explain how to use aliases feature also? thanks for sharing knowledge!

more how many left total for pyspark?

Thanks Budy

Is it similar to sql window functions?

I think we can use 'monthdiff' after where in 1st question right? rather than repeating whole datediff() line

Sir, kindly add Azure Synapse videos

im getting below error: wile debuging in get meta data activity no errors and all file copied to output folder evne before trigger then after triggering im getting below erro message Failed to run foreachitrate (Pipeline). {"code":"BadRequest","message":"ErrorCode=InvalidTemplate, ErrorMessage=The template validation failed: 'The 'runAfter' property of template action 'ForEach1Scope' is not valid. The status values for action 'Get Metadata1Scope' must be unique. Found duplicate values: 'Succeeded'","target":"pipeline/foreachitrate/runid/c2f978e0-100a-4235-a1dd-5caa8c62a25e","details":null}

how do we know that we have to pass only name in wildcard?

hi what about in a single trigger cant we provide multiple filepath and table name

Thank you brooo

This playlist has 58 videos, is it enough to learn from scratch and get a job of azure data engineer with 3 yrs of experience?? If not , please let us know on what else need to be done to achieve it

So grateful for this content. Thank you!

it is nice how you covered all these complex things in such a small timespan

for amazon redshift dataware house, can you upload some tutorial ? and also some data engineering project which covers all these services can you do one video? it will be very useful ?

bro your content is the best so far :) thankyou so much

Hi sir is your playlist for pyspark enough to completely learn pyspark ?

error: Dataset is using 'AzureSqlDatabase' linked service with SQLVersion 'Recommended', which is not supported in data flow.

On second slide you have mentioned ' We have to build one pipeline which will transfer data and run daily' What do you mean by run daily ?

Thanks

This helps df to convert to spark table very useful 🙂

can we take Central India in region in free subscription?

while publishing the trigger im getting below error please help The Microsoft.EventGrid resource provider is not registered in subscription 0bc822f0-35e3-4b16-bc69-bb4d69d152d3. Register the provider in the subscription and retry the operation. Activity id:0cc9f3e7-26da-4503-8e86-9bbca505a7f4, please reply